-- Logs begin at Mon 2022-01-10 12:09:32 UTC, end at Mon 2022-01-10 13:05:06 UTC. -- Jan 10 12:39:13.903992 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 10 12:39:13.913538 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 10 12:39:13 2022] *** Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: nodename: dv-cinder-master-3-iscsi Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: machine: x86_64 Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: clock source: unix Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: pcre jit disabled Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: detected number of CPU cores: 4 Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: current working directory: / Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: detected binary path: /usr/bin/uwsgi-core Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: your processes number limit is 47680 Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: your memory page size is 4096 bytes Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: detected max file descriptor number: 2048 Jan 10 12:39:13.915466 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: lock engine: pthread robust mutexes Jan 10 12:39:13.916276 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: thunder lock: enabled Jan 10 12:39:13.916276 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 10 12:39:13.916276 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 10 12:39:13.968654 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: Python main interpreter initialized at 0x55e3463b79c0 Jan 10 12:39:13.968654 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: python threads support enabled Jan 10 12:39:13.968654 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: your server socket listen backlog is limited to 100 connections Jan 10 12:39:13.968654 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: your mercy for graceful operations on workers is 90 seconds Jan 10 12:39:13.969008 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: mapped 403077 bytes (393 KB) for 2 cores Jan 10 12:39:13.969071 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: *** Operational MODE: preforking *** Jan 10 12:39:13.969317 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: *** uWSGI is running in multiple interpreter mode *** Jan 10 12:39:13.969317 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: spawned uWSGI master process (pid: 108689) Jan 10 12:39:13.969522 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 10 12:39:13.970345 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: spawned uWSGI worker 1 (pid: 108690, cores: 1) Jan 10 12:39:13.970455 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: spawned uWSGI worker 2 (pid: 108691, cores: 1) Jan 10 12:39:13.970523 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 10 12:39:15.759828 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:39:15.759828 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: from cryptography.utils import int_from_bytes Jan 10 12:39:15.760406 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:39:15.760406 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: from cryptography.utils import int_from_bytes Jan 10 12:39:15.782226 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:39:15.782226 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: from cryptography.utils import int_from_bytes Jan 10 12:39:15.782795 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:39:15.782795 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: from cryptography.utils import int_from_bytes Jan 10 12:39:18.335200 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 12:39:18.335888 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 12:39:18.335973 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 12:39:18.336078 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 12:39:18.336414 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 12:39:18.336487 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 12:39:18.336564 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 12:39:18.336796 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 12:39:18.336944 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.337152 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 12:39:18.337297 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.337383 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 12:39:18.337558 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.337784 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.337926 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.338070 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.338167 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.338419 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.338551 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.338908 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.339050 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.339144 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.339219 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.339499 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.339671 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.339761 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.339847 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.340093 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.340241 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.340406 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.340505 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.340712 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.340802 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.341017 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.341114 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.341340 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.341429 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.341660 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.341748 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.341965 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.342065 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.342273 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.342366 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.342580 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.342666 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.342890 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.343072 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.343478 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.343602 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.343672 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.343850 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.344042 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.344148 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.344359 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.344474 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.344667 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.344785 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.344983 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.345093 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.345321 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.345410 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.345640 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.345771 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.345950 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.346039 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.346273 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.346369 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.346570 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.346687 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.346894 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.347006 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.347205 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.347322 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.347631 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.347773 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.347951 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.348065 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.348265 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.348379 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.348582 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.348689 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.348996 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.349084 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.349312 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.349410 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.349618 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.349709 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.349937 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.350027 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.350256 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.350350 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.350563 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.350654 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.350883 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.350966 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.351189 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.351303 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.351499 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.351616 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.351828 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.351914 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.352140 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.352232 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.352442 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.352532 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.352748 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.352833 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353000 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353172 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353297 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353379 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353623 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353708 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353896 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.353983 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.354241 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.354351 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.354545 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.354652 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.354798 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.354977 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.355117 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.355203 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.355439 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.355569 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.355717 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.355820 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.356040 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.356125 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.356363 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.356458 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.356670 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.356754 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.356977 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.357060 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.357281 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.357371 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.357589 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.357677 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.357896 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.357981 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.358208 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.358300 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.358520 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.358610 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.358831 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.358917 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.359139 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.359222 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.359457 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.359594 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.359809 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.359921 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.360121 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.360204 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.360430 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.360584 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.360771 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.360865 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.361068 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.361153 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.361381 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.361469 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.361702 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.361798 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.362029 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.362122 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.362340 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.362424 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.362647 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.362745 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.362955 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.363083 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.363268 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.363400 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.363600 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.363708 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.363913 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.364008 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.364164 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.364254 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.364467 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.364553 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.364772 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.364857 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.365093 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.365179 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.365398 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.365482 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.365705 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.365827 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.366011 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.366097 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.366315 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.366406 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.366623 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.366707 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.366932 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.367020 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.367239 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.367323 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.367566 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.367654 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.367876 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.367974 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.368183 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.368268 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.368492 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.368575 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.368795 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.368886 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.369100 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.369185 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.369410 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.369494 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.369718 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.369844 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.370060 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.370257 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.370628 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.370709 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.370709 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.370862 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.370989 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.371110 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.371298 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.371431 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.371639 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.371764 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.371950 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.372075 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.372274 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.372400 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.372584 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.372710 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.372893 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.373021 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.373218 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.373350 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.373528 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.373625 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.373835 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.373920 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.374154 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.374239 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.374461 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.374556 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.374771 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.374856 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.375093 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.375178 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.375398 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.375484 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.375732 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.375818 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.376036 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.376118 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.376341 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.376433 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.376649 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.376740 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.376951 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.377036 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.377650 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.377737 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.377823 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.377902 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.377978 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.378061 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.378148 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.378228 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.378436 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.378520 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.378737 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.378830 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.379041 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.379124 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.379350 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.379435 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.379688 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.379787 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.380000 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.380085 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.380307 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.381268 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.381372 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:39:18.381508 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.381602 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.381683 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.381683 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.381834 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.381921 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382007 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382086 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382162 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382246 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382324 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382524 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382611 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382852 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.382938 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.383167 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.383261 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.383480 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.383614 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.383819 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.383905 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.384140 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.384224 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.384454 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.384540 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.384769 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.384861 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.385083 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.385174 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.385401 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.385501 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.385757 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.385912 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.386229 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.386319 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.386552 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.386638 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.386874 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.386963 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.387189 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.387275 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.387502 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.387608 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.387866 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.387951 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.388191 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.388284 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.388507 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.388593 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.388833 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.388924 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.389147 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.389251 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.389477 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.389562 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.389790 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.389882 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.390100 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.390193 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.390412 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.390495 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.390725 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.390807 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.391039 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.391125 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.391355 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.391440 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.391709 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.391795 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.392025 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.392112 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.392340 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.392425 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.392652 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.392736 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.392969 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.393061 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.393268 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.393361 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.393580 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.393673 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.393885 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.393981 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.394192 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.394277 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.394506 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.394597 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.394814 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.394908 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.395136 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.395227 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.395444 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.395580 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.395789 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.395873 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.396105 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.396188 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.396414 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.396511 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.396729 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.396813 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.397040 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.397122 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.397347 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.397440 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.397668 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.397751 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.397978 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.398061 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.398283 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.398381 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.398604 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.398694 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.398910 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.398994 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.399214 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.399298 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.399548 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.399635 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.399859 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.399943 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.400168 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.400255 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.400480 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.400562 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.400788 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.400871 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.401220 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.401323 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.401473 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.401557 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.401811 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.401904 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.402146 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.402240 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.402456 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.402541 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.402782 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.402877 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.403109 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.403193 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.403416 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.403499 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.403752 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.403858 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.404065 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.404158 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.404371 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.404457 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.404679 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.404772 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.404986 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.405070 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.405289 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.405382 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.405595 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.405695 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.405900 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.405985 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.406204 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.406288 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.406510 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.406601 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.406812 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.406895 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.407118 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.407203 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.407425 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.407552 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.407754 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.407839 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.408064 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.408156 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.408371 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.408463 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.408675 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.408759 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.408982 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.409066 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.409288 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.409374 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.409633 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.409718 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.409944 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.410045 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.410274 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.410366 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.410589 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.410680 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.410907 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.411001 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.411222 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.411307 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.411553 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.411666 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.411870 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.411985 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.412178 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.412262 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.412493 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.412616 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.412804 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.412897 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.413114 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.413197 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.413423 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.413506 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.413732 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.413935 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.414044 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.414136 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.414355 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.414439 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.414657 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.414741 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.414972 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.415063 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.415288 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.415373 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.415617 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.415707 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.415939 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.416023 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.416262 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.416344 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.416574 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.416661 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.416944 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.417041 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.417226 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.417373 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.417555 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.417696 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.417956 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.418041 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.418269 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.418363 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.418589 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.418682 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.418900 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.418985 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.419209 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.419300 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.419533 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.419620 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.419850 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.419934 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.420158 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.420257 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.420467 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.420551 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.420770 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.420853 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.421084 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.421182 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.421400 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.421484 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.421708 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.421794 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.422022 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.422109 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.422337 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.422420 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.422660 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.422753 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.422974 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.423059 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.423283 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.423373 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.423620 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.423710 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.423934 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.424043 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.424243 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.424342 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.424552 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.424637 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.424859 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.424945 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.425167 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.425252 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.425476 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.425568 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.425781 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.425867 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.426089 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.426179 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.426398 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.426491 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.426701 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.426791 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.427006 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.427099 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.427316 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.427408 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.427650 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.427749 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.427958 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.428043 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.428268 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.428362 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.428590 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.428673 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.428898 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.428984 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.429201 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.429287 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.429524 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.429608 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.429827 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.429910 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.430132 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.430223 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.430441 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.430532 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.430745 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.430829 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.431049 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.431134 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.431358 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.431467 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.431689 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.431788 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.432015 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.432101 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.432376 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.432462 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.432685 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.432778 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.433001 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.433091 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.433313 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.433399 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.433623 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.433716 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.433939 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.434085 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.434253 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.434350 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.434559 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.434654 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.434872 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.434963 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.435182 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.435274 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.435489 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.435651 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.435825 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.435916 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.436139 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.436252 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.436450 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.436586 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.436760 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.436859 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.437071 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.437168 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.437375 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.437472 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.437686 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.438153 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.438367 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.438470 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.438677 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.438940 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.439060 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.439272 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.439369 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.439616 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.439879 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.439977 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.440212 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.440301 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.440528 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.440625 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.440851 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.440939 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.441170 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.441288 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.441487 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.441587 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.441795 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.441884 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.442110 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.442247 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.442416 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.442516 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.442722 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.442814 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.443031 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.443114 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.443335 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.443429 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.443668 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.443764 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.443973 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.444056 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.444296 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.444421 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.444580 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.444665 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.444883 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.444966 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.445197 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.445309 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.445505 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.445590 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.445811 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.445909 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.446114 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.446253 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.446424 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.446567 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.446728 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.446881 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.447049 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.447182 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.447359 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.447498 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.447689 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.447831 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.448024 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.448162 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.448386 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.448577 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.448711 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.448842 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.448994 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.449133 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.449272 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.449402 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.449555 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.449695 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.449862 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.449994 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.450204 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.450338 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.450512 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.450644 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.450839 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.450980 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.451145 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.451279 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.451451 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.451619 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.451780 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.451924 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.452093 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.452227 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.452398 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.452525 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.452700 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.452849 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.453009 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.453141 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.453318 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.453451 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.453619 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.453767 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.453926 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.454058 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.454231 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.454360 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.454541 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.454683 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.454831 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.454966 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.455142 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.455322 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.455464 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.455611 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.455765 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.455897 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.456072 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.456200 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.456384 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.456534 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.456672 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.456812 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.456977 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.457109 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.457285 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.457372 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.457589 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.457722 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.457895 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.458034 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.458200 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.458332 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.458503 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.458650 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.458807 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.458950 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.459113 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.459250 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.459418 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.459573 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.459744 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.459844 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.460069 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.460154 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.460382 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.460467 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.460689 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.460784 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.460993 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.461085 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.461300 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.461392 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.461607 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.461693 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.461910 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.461994 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.462221 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.462305 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.462527 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.462635 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.462834 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.462919 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.463137 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.463246 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.463445 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.463653 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.463918 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.464063 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.464253 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.464386 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.464524 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.464621 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.464830 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.464914 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.465133 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.465224 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.465441 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.465531 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.465745 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.465864 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.466048 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.466183 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.466350 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.466435 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.466656 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.466739 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.466962 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.467115 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.467266 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.467357 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.467597 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.467697 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.467906 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.468001 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.468210 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.468294 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.468518 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.468603 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.468825 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.468911 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.469171 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.469256 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.469478 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.469563 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.469799 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.469883 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.470114 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.470198 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.470427 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.470518 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.470744 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.470830 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.471053 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.471137 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.471366 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.471455 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.471700 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.471785 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.472010 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.472093 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.472313 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.472396 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.472621 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.472710 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.472936 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.473020 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.473243 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.473337 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.473549 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.473634 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.473871 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.473957 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.474184 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.474278 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.474497 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.474581 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.474799 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.474893 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.475111 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.475241 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.475422 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.475508 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.475756 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.475842 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.476065 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.476170 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.476373 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.476459 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.476680 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.476763 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.476990 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.477076 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.477303 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.477428 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.477612 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.477728 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.477922 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.478007 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.478225 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.478309 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.478535 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.478626 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.478842 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.478926 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.479146 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.479407 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.479557 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.479647 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.479854 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.480023 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.480164 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.480337 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.480478 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.480669 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.480784 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.480986 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.481101 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.481295 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.481415 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.481606 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.481848 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.481933 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.482166 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.482250 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.482484 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.482574 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.482795 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.482929 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.483108 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.483252 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.483425 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.483598 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.483767 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.483908 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.484088 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.484224 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.484396 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.484541 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.484817 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.484902 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.485131 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.485223 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.485454 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.485546 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.485768 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.485874 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.486074 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.486190 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.486379 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.486507 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.486690 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.486820 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.487016 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.487130 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.487323 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.487438 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.487652 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.487778 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.487958 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.488106 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.488285 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.488413 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.488591 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.488719 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.488914 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.489009 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.489333 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.489418 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.489637 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.489720 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.489942 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.490034 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.490356 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.490442 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.490668 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.490751 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.490977 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.491075 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.491304 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.491396 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.491649 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.491750 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.491982 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.492069 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.492290 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.492374 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.492607 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.492730 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.492918 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.493004 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.493242 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.493332 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.493560 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.493652 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.493868 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.493952 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.494181 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.494267 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.494488 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.494572 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.496702 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.496838 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.496838 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.496987 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497073 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497162 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497249 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497327 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497327 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497466 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497543 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497629 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497715 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497794 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497794 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.497952 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498020 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498099 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498176 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498262 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498342 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498419 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498542 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498674 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498849 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.498985 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.499156 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.499297 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.499483 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.499641 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.499821 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.499918 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.500135 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.500221 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.500448 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.500541 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.500758 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.500852 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.501064 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.501149 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.501376 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.501461 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.501701 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.501788 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.502006 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.502095 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.502318 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.502409 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.502633 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.502717 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.502938 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.503030 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.503263 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.503355 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.503595 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.503695 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.503925 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.504009 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.504233 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.504327 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.504541 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.504627 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.504848 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.504933 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.505152 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.505245 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.505459 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.505543 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.505769 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.505854 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.506077 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.506171 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.506414 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.506497 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.506724 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.506808 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.507043 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.507135 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.507374 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.507459 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.507723 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.507807 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.508035 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.508122 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.508352 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.508437 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.508676 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.508762 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.508983 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.509073 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.509288 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.509382 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.509598 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.509691 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.509901 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.509988 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.510204 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.510288 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.510669 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.510854 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511265 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511349 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511428 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511507 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511628 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511725 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511806 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.511885 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.512117 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.512211 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.512424 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.512516 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.512728 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.512812 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.513042 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.513137 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.513345 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.513438 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.513647 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.513730 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.513950 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.514036 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.514259 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.514352 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.514569 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.514662 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.514877 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.514962 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.515213 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.515299 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.515535 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.515623 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.515886 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.515981 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.516192 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.516278 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.516516 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.516599 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.516833 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.516921 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.517150 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.517238 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.517465 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.517549 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.517784 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.517869 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.518100 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.518331 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.518426 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.518505 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.518716 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.518812 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.519028 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.519113 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.519344 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.519431 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.519681 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.519781 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.519993 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.520085 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.520312 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.520527 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.520613 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.520856 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.520942 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.521172 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.521455 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.521541 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.521788 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.521882 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.522102 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.522187 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.522419 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.522539 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.522730 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.522817 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.523041 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.523126 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.523352 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.523438 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.523688 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.523788 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.524001 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.524085 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.524319 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.524411 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.524636 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.524724 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.524968 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.525054 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.525282 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.525373 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.525600 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.525685 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.525917 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.526003 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.526327 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.526424 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.526653 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.526759 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.526969 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.527056 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.527288 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.527375 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.527653 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.527752 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.527976 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.528061 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.528285 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.528370 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.528597 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.528681 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.528908 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.529009 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.529222 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.529320 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.529532 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.529624 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.529842 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.529936 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.530153 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.530239 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.530465 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.530550 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.530777 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.530870 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.531084 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.531169 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.531398 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.531483 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.531747 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.531836 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.532060 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.532144 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.532403 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.532490 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.532723 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.532810 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.533040 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.533236 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.533358 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.533550 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.533676 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.533882 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.534199 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.534286 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.534519 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.534605 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.534834 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.534919 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.535150 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.535243 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.535479 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.535621 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.535811 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.535897 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.536116 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.536208 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.536427 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.536526 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.536737 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.536830 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.537043 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.537135 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.537358 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.537452 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.537666 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.537751 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.538066 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.538150 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.538504 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.538599 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.538875 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.538967 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.539253 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.539509 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.539667 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.539884 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.539971 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.540228 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.540565 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.540649 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.541034 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.541119 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.541420 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.541558 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.541853 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.541998 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.542236 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.542409 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.542545 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.542853 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.542937 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.543234 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.543471 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.543655 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.543843 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.543971 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.544167 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.544302 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.544488 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.544654 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.544817 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.544970 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.545138 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.545278 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.545456 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.545592 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.545774 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.545900 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.546095 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.546375 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.546477 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.546566 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.546714 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.546808 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.547031 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.547127 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.547342 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.547428 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.547703 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.547793 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.548018 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.548116 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.548325 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.548410 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.548633 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.548709 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.548946 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.549033 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.549250 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.549336 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.549555 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.549639 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.549858 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.549960 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.550166 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.550261 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.550468 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.550553 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.550776 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.550863 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.551078 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.551163 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.551384 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.551477 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.551722 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.551810 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.552028 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.552129 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.552339 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.552432 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.552645 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.552731 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.552966 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.553058 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.553272 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.553471 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.553561 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.553641 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.553884 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.553970 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.554196 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.554292 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.554523 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.554733 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.554827 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.555118 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.555221 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.555442 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.555547 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.555811 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.555900 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.556150 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.556348 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.556460 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.556744 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.556839 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.557059 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.557181 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.557427 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.557518 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.557811 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.557899 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.558123 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.558209 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.558430 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.558516 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.558739 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.558840 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.559050 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.559146 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.559361 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.559447 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.559698 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.559788 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.560010 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.560109 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.560322 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.560420 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.560634 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.560719 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.560948 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.561112 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.561264 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.561352 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.561578 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.561673 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.561892 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.561980 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.562214 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.562314 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.562541 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.562632 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.563191 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.563322 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.563503 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.563610 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.563833 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.563923 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.564148 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.564236 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.564470 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.564555 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.564779 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.564872 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.565083 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.565170 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.565397 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.565504 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.565715 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.565809 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.566049 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.566142 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.566366 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.566466 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.566677 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.566771 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.567041 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.567200 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.567352 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.567456 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.567688 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.567779 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.568011 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.568105 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.568321 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.568409 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.568650 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.568778 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.568977 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.569063 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.569290 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.569378 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.569615 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.569710 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.569918 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.570010 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.570223 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.570319 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.570535 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.570623 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.570847 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.570934 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.571179 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.571277 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.571498 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.571611 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.571830 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.571917 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.572139 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.572238 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.572451 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.572634 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.572774 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.572872 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.573133 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.573229 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.573457 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.573553 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.573781 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.573880 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.574093 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.574187 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.574403 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.574488 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.574716 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.574801 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.575031 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.575117 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.575341 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.575484 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.575677 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.575765 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.575986 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.576073 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.576292 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.576378 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.576602 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.576698 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.576923 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.577009 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.577237 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.577323 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.577545 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.577637 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.577855 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.577947 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.578167 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.578254 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.578486 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.578584 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.578803 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.578890 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.579110 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.579197 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.579438 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.579561 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.579773 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.579861 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.580089 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.580177 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.580399 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.580488 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.580709 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.580797 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.581023 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.581110 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.581340 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.581426 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.581658 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.581744 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.581969 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.582066 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.582282 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.582370 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.582599 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.582685 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.582915 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.583014 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.583242 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.583335 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.583593 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.583682 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.583925 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.584025 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.584242 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.584328 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.584552 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.584639 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.584856 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.584959 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.585103 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108690) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 12:39:18.585264 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.585551 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.585867 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.586181 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.586487 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:39:18.586733 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 12:39:18.608227 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_db.sqlalchemy.engines [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:18.609330 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_db.sqlalchemy.engines [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:18.675502 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.context [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03a79a3-f043-4ae0-9ae4-2ca83e1a8894(cell1) {{(pid=108690) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 12:39:18.675779 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.context [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03a79a3-f043-4ae0-9ae4-2ca83e1a8894(cell1) {{(pid=108691) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 12:39:18.679774 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:39:18.679876 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_concurrency.lockutils [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:39:18.681341 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:39:18.681557 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_concurrency.lockutils [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:39:18.682154 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:39:18.682404 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_concurrency.lockutils [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:39:18.684135 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:39:18.684379 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_concurrency.lockutils [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:39:18.695399 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_db.sqlalchemy.engines [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:18.698740 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_db.sqlalchemy.engines [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:18.700963 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_db.sqlalchemy.engines [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:18.705897 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_db.sqlalchemy.engines [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:18.867383 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_db.sqlalchemy.engines [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108690) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:18.870175 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG oslo_db.sqlalchemy.engines [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:39:19.212413 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: WARNING keystonemiddleware.auth_token [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:39:19.214384 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: WARNING keystonemiddleware.auth_token [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:39:19.219347 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: WARNING keystonemiddleware.auth_token [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:39:19.221286 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: WARNING keystonemiddleware.auth_token [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:39:19.562573 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: WARNING keystonemiddleware.auth_token [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:39:19.565952 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: WARNING keystonemiddleware.auth_token [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:39:19.568069 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: WARNING keystonemiddleware.auth_token [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:39:19.571499 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: WARNING keystonemiddleware.auth_token [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:39:19.573518 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3463b79c0 pid: 108690 (default app) Jan 10 12:39:19.575624 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:39:19.576815 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-08195993-d623-45b9-9bcf-cd8ce6f46eaa None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001783 Jan 10 12:39:19.576947 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3463b79c0 pid: 108691 (default app) Jan 10 12:39:19.577206 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon Jan 10 12:39:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:40:48.534928 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:40:48.536354 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002316 Jan 10 12:40:48.536857 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:40:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:40:48.994464 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-b75287ef-b74f-47da-98c9-57d4dcb1a831 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:40:49.022851 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-b75287ef-b74f-47da-98c9-57d4dcb1a831 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480019 Jan 10 12:40:49.023813 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jan 10 12:40:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:40:51.480820 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:40:51.481913 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-ee8e8bde-cad1-41e6-b997-de75b508e20a None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Jan 10 12:40:51.482400 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:40:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:40:51.545034 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-9e6b2f82-97f4-44ce-8b04-f91356f2d399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "id": "c1", "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:51.563395 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:40:51.563395 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: warnings.warn(msg) Jan 10 12:40:51.595142 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-9e6b2f82-97f4-44ce-8b04-f91356f2d399 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106749 Jan 10 12:40:51.597648 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:40:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:40:51.856818 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-a72dcd3e-456c-4ac6-beca-81c092cfd356 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:51.859356 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:40:51.859356 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: warnings.warn(msg) Jan 10 12:40:51.944357 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-a72dcd3e-456c-4ac6-beca-81c092cfd356 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339087 Jan 10 12:40:51.945043 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jan 10 12:40:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:40:54.413644 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-9e6b2f82-97f4-44ce-8b04-f91356f2d399 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:40:54.414695 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-9e6b2f82-97f4-44ce-8b04-f91356f2d399 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jan 10 12:40:54.415407 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:40:54.522889 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-102f6453-27ad-4cc9-85db-3783eb4212e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:54.540691 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:40:54.540691 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: warnings.warn(msg) Jan 10 12:40:54.564757 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-102f6453-27ad-4cc9-85db-3783eb4212e7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143381 Jan 10 12:40:54.565695 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:40:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:40:54.577938 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-676af5d6-2c3d-4e9c-aba2-f476107996f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:54.579581 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:40:54.579581 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: warnings.warn(msg) Jan 10 12:40:54.613747 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-676af5d6-2c3d-4e9c-aba2-f476107996f7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039479 Jan 10 12:40:54.623928 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jan 10 12:40:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:40:57.066452 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-102f6453-27ad-4cc9-85db-3783eb4212e7 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:40:57.067385 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-102f6453-27ad-4cc9-85db-3783eb4212e7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jan 10 12:40:57.067808 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:40:57.126691 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-37f78525-2be3-41fa-a41c-a673eb7b4848 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:57.149348 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-37f78525-2be3-41fa-a41c-a673eb7b4848 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075319 Jan 10 12:40:57.150309 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:40:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:40:57.161813 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-f1e40847-3651-46ab-92c2-ee44d588983c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:57.190679 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-f1e40847-3651-46ab-92c2-ee44d588983c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032506 Jan 10 12:40:57.191711 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jan 10 12:40:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:40:59.759408 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-37f78525-2be3-41fa-a41c-a673eb7b4848 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:40:59.760742 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-37f78525-2be3-41fa-a41c-a673eb7b4848 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Jan 10 12:40:59.761161 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:40:59.830276 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-1fe604ae-ea22-486c-9a69-3208cc98ae53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "vcpus": 2}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:59.859173 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-1fe604ae-ea22-486c-9a69-3208cc98ae53 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091344 Jan 10 12:40:59.860605 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:40:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:40:59.874533 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-fb39ac0b-a5b6-4c86-b645-cfd5b40e8cdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:40:59.906268 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-fb39ac0b-a5b6-4c86-b645-cfd5b40e8cdb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035332 Jan 10 12:40:59.907142 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jan 10 12:40:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:41:02.424567 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-1fe604ae-ea22-486c-9a69-3208cc98ae53 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:02.425534 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-1fe604ae-ea22-486c-9a69-3208cc98ae53 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 10 12:41:02.426168 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:02.489244 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-c0d562ed-e091-4869-a1c9-0f0a7c7f3b70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:02.511200 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-c0d562ed-e091-4869-a1c9-0f0a7c7f3b70 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077840 Jan 10 12:41:02.515736 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:41:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:02.530526 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-0bb15665-2149-4575-ada7-449ba24ff37c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:02.555734 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-0bb15665-2149-4575-ada7-449ba24ff37c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032305 Jan 10 12:41:02.564107 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jan 10 12:41:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:41:05.074829 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-c0d562ed-e091-4869-a1c9-0f0a7c7f3b70 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:05.076279 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-c0d562ed-e091-4869-a1c9-0f0a7c7f3b70 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Jan 10 12:41:05.076861 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:05.142595 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-a68dcb97-650a-4afe-bb1d-61fcfaa95200 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:05.174568 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-a68dcb97-650a-4afe-bb1d-61fcfaa95200 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090687 Jan 10 12:41:05.175336 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jan 10 12:41:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:41:07.706583 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-c0d562ed-e091-4869-a1c9-0f0a7c7f3b70 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:07.707635 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-c0d562ed-e091-4869-a1c9-0f0a7c7f3b70 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jan 10 12:41:07.708272 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:41:07.770680 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-a161c9e5-1118-4f63-9266-598de1c57bbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:07.793320 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-a161c9e5-1118-4f63-9266-598de1c57bbe admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079005 Jan 10 12:41:07.793917 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:41:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:07.806273 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-8564b0d8-d571-4767-aa3f-78862e7c3d3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:07.831205 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-8564b0d8-d571-4767-aa3f-78862e7c3d3b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028949 Jan 10 12:41:07.831862 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jan 10 12:41:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:41:10.345660 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-a161c9e5-1118-4f63-9266-598de1c57bbe admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:10.346683 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-a161c9e5-1118-4f63-9266-598de1c57bbe admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jan 10 12:41:10.347063 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:10.404411 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-f468972e-733f-4e8c-b653-0658dc6cf9b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:10.426052 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-f468972e-733f-4e8c-b653-0658dc6cf9b6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072869 Jan 10 12:41:10.426800 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:41:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:41:10.439013 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-9dc59606-9d96-4eab-8eda-635b2fb95650 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:10.462389 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-9dc59606-9d96-4eab-8eda-635b2fb95650 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027572 Jan 10 12:41:10.463078 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jan 10 12:41:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:41:12.896554 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-f468972e-733f-4e8c-b653-0658dc6cf9b6 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:12.897613 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-f468972e-733f-4e8c-b653-0658dc6cf9b6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jan 10 12:41:12.898044 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:12.956614 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-498aa85a-7053-4066-b42c-6a7667038792 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "swap": 0, "id": "3"}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:12.978031 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-498aa85a-7053-4066-b42c-6a7667038792 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073762 Jan 10 12:41:12.978915 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:41:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:12.990359 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-1c4b77c0-bbb0-4147-9785-de1606180060 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:13.015485 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-1c4b77c0-bbb0-4147-9785-de1606180060 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028523 Jan 10 12:41:13.015750 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jan 10 12:41:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:41:15.505008 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-498aa85a-7053-4066-b42c-6a7667038792 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:15.507225 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-498aa85a-7053-4066-b42c-6a7667038792 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002602 Jan 10 12:41:15.512976 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:15.569900 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-1631c54f-ef69-4e8f-a6f3-88fe7d63b3f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:15.591301 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-1631c54f-ef69-4e8f-a6f3-88fe7d63b3f8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076926 Jan 10 12:41:15.592154 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:41:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:15.604350 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-72abfa5c-f66c-4ac8-81b0-5f24afa70119 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:15.628452 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-72abfa5c-f66c-4ac8-81b0-5f24afa70119 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028002 Jan 10 12:41:15.629744 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jan 10 12:41:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:41:18.127179 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-1631c54f-ef69-4e8f-a6f3-88fe7d63b3f8 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:18.128323 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-1631c54f-ef69-4e8f-a6f3-88fe7d63b3f8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jan 10 12:41:18.128731 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:18.190497 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-5136cceb-9cc8-4e73-8dcc-9f19820b461f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:18.209611 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-5136cceb-9cc8-4e73-8dcc-9f19820b461f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074920 Jan 10 12:41:18.210488 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jan 10 12:41:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:41:18.222325 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-062d528f-adb5-401f-9eac-5db90d8d4402 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:18.247807 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-062d528f-adb5-401f-9eac-5db90d8d4402 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029198 Jan 10 12:41:18.248854 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jan 10 12:41:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:41:39.207573 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-5136cceb-9cc8-4e73-8dcc-9f19820b461f admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:39.208609 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-5136cceb-9cc8-4e73-8dcc-9f19820b461f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jan 10 12:41:39.209000 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:39.269644 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-1c877253-0557-462a-8c4f-7690df12b48b admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:39.286800 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-1c877253-0557-462a-8c4f-7690df12b48b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070087 Jan 10 12:41:39.287319 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jan 10 12:41:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:41:40.943991 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-5136cceb-9cc8-4e73-8dcc-9f19820b461f admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:40.945007 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-5136cceb-9cc8-4e73-8dcc-9f19820b461f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jan 10 12:41:40.945434 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:41.151115 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-171bc866-8efc-4deb-a94c-f24ea2aa20a9 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:41.160392 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.wsgi [None req-171bc866-8efc-4deb-a94c-f24ea2aa20a9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 10 12:41:41.161326 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-171bc866-8efc-4deb-a94c-f24ea2aa20a9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:41:41.162752 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-171bc866-8efc-4deb-a94c-f24ea2aa20a9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.079575 Jan 10 12:41:41.163597 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jan 10 12:41:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:41.173311 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-6ed766a0-1ed2-4358-9e1f-b4ca21d83089 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:41.194684 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-6ed766a0-1ed2-4358-9e1f-b4ca21d83089 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024889 Jan 10 12:41:41.195218 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jan 10 12:41:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:41:41.208106 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-2950d15f-04b6-42f9-bdd5-1399792aae89 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:41.236420 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-2950d15f-04b6-42f9-bdd5-1399792aae89 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034279 Jan 10 12:41:41.236959 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jan 10 12:41:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:41:41.246555 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-6d35c0e9-c738-4d1d-8fd5-85b28cd39c61 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:41.252579 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.wsgi [None req-6d35c0e9-c738-4d1d-8fd5-85b28cd39c61 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 10 12:41:41.253151 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-6d35c0e9-c738-4d1d-8fd5-85b28cd39c61 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:41:41.253949 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-6d35c0e9-c738-4d1d-8fd5-85b28cd39c61 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011050 Jan 10 12:41:41.254448 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jan 10 12:41:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:42.783235 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-2950d15f-04b6-42f9-bdd5-1399792aae89 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:42.784597 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-2950d15f-04b6-42f9-bdd5-1399792aae89 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 10 12:41:42.784953 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:42.984053 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-20b978c2-3617-4181-b242-7d31773b0275 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:42.989570 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.wsgi [None req-20b978c2-3617-4181-b242-7d31773b0275 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 10 12:41:42.990129 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-20b978c2-3617-4181-b242-7d31773b0275 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:41:42.990917 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-20b978c2-3617-4181-b242-7d31773b0275 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067151 Jan 10 12:41:42.991434 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jan 10 12:41:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:43.000690 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-9ac6cd44-43ad-462d-9542-bcab8c49d5c5 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:43.014277 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-9ac6cd44-43ad-462d-9542-bcab8c49d5c5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017157 Jan 10 12:41:43.014770 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jan 10 12:41:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:41:43.024073 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-f65fdb25-56e7-46bc-9e3e-bd27b3bdfea7 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:43.039475 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-f65fdb25-56e7-46bc-9e3e-bd27b3bdfea7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018632 Jan 10 12:41:43.040332 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jan 10 12:41:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:41:43.054694 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-e347f466-6256-4e52-8dde-d03fa90f9a71 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:43.060567 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.wsgi [None req-e347f466-6256-4e52-8dde-d03fa90f9a71 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 10 12:41:43.061127 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-e347f466-6256-4e52-8dde-d03fa90f9a71 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:41:43.062282 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-e347f466-6256-4e52-8dde-d03fa90f9a71 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013159 Jan 10 12:41:43.062780 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jan 10 12:41:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:44.608308 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-f65fdb25-56e7-46bc-9e3e-bd27b3bdfea7 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:44.609308 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-f65fdb25-56e7-46bc-9e3e-bd27b3bdfea7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 10 12:41:44.609703 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:44.821307 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-c83917c7-258b-4798-8871-b525d23bd0fd admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:44.826633 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.wsgi [None req-c83917c7-258b-4798-8871-b525d23bd0fd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 10 12:41:44.827194 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-c83917c7-258b-4798-8871-b525d23bd0fd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:41:44.828039 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-c83917c7-258b-4798-8871-b525d23bd0fd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072439 Jan 10 12:41:44.828545 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jan 10 12:41:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:44.837971 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-50eadef9-1783-4b8c-b4f2-ec7084946490 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:44.851375 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-50eadef9-1783-4b8c-b4f2-ec7084946490 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017030 Jan 10 12:41:44.852043 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jan 10 12:41:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:41:44.862340 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:44.876902 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018647 Jan 10 12:41:44.877425 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jan 10 12:41:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:41:44.886931 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-05aad76a-1132-4785-9523-58fa2530cd1f admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:44.892467 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.wsgi [None req-05aad76a-1132-4785-9523-58fa2530cd1f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 10 12:41:44.893027 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-05aad76a-1132-4785-9523-58fa2530cd1f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:41:44.893813 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-05aad76a-1132-4785-9523-58fa2530cd1f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010703 Jan 10 12:41:44.894304 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jan 10 12:41:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:46.432874 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:46.433882 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jan 10 12:41:46.434275 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:46.638563 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-d3939103-57cc-492f-a282-21a69a7ec04c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:46.660948 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-d3939103-57cc-492f-a282-21a69a7ec04c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.084864 Jan 10 12:41:46.661484 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jan 10 12:41:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:48.230690 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:48.232073 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 Jan 10 12:41:48.232677 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:48.443393 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-4e71bf4e-c001-406d-ad9a-85067145aadf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:48.464953 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-4e71bf4e-c001-406d-ad9a-85067145aadf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085031 Jan 10 12:41:48.465492 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jan 10 12:41:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:50.002131 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:50.003125 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jan 10 12:41:50.003532 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:50.203941 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-a17b7547-460a-4465-aee9-1219fd894a92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:50.228661 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-a17b7547-460a-4465-aee9-1219fd894a92 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.088268 Jan 10 12:41:50.229204 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jan 10 12:41:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:51.772915 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:51.773962 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jan 10 12:41:51.774359 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:51.983909 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-1ce5804d-5881-433d-b5d6-b1103a660025 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:41:52.003169 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-1ce5804d-5881-433d-b5d6-b1103a660025 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.083404 Jan 10 12:41:52.003760 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jan 10 12:41:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:41:53.544811 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:53.545824 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jan 10 12:41:53.546216 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:41:53.750930 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-b08e3f8b-a0b5-4259-8d69-f3047468cf2e admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:41:53.770608 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-b08e3f8b-a0b5-4259-8d69-f3047468cf2e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083884 Jan 10 12:41:53.771159 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon Jan 10 12:41:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:42:42.585013 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:42:42.586500 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-570645ab-26c1-4126-9b36-e631e71dd017 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Jan 10 12:42:42.587099 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jan 10 12:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:42:42.652098 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-a86db6dc-d7cc-49b3-bd67-6db0e23637c1 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:42:42.671117 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-a86db6dc-d7cc-49b3-bd67-6db0e23637c1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077725 Jan 10 12:42:42.671675 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jan 10 12:42:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:42:42.693774 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-d0c5f64e-d057-4853-8a6b-339f1a0c2df6 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:42:42.701767 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-d0c5f64e-d057-4853-8a6b-339f1a0c2df6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011582 Jan 10 12:42:42.702282 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jan 10 12:42:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:42:42.713353 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-a8a72dca-40e1-4017-9c69-e698e9ae37ef admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:42:42.721716 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-a8a72dca-40e1-4017-9c69-e698e9ae37ef admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011919 Jan 10 12:42:42.722235 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jan 10 12:42:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:42:42.733704 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-f5fab600-b8e2-4784-98ba-1403a5564521 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:42:42.741902 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-f5fab600-b8e2-4784-98ba-1403a5564521 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011728 Jan 10 12:42:42.742445 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jan 10 12:42:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:42:42.754089 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:42:42.762204 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011757 Jan 10 12:42:42.762724 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jan 10 12:42:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:44:14.052009 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-30086bd9-b0f9-4480-aa6a-cb066ad6bd30 tempest-verify_tempest_config-668359047 tempest-verify_tempest_config-668359047-project] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:44:14.053973 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-30086bd9-b0f9-4480-aa6a-cb066ad6bd30 tempest-verify_tempest_config-668359047 tempest-verify_tempest_config-668359047-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.120181 Jan 10 12:44:14.054557 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 35/69] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jan 10 12:44:13 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:45:40.806062 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:40.806695 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 10 12:45:40.807086 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:45:41.079856 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-9c7f7697-65cc-467d-a143-430ae923226b admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:41.081086 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:45:41.081086 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: warnings.warn(msg) Jan 10 12:45:41.082623 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-9c7f7697-65cc-467d-a143-430ae923226b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:41.083064 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-9c7f7697-65cc-467d-a143-430ae923226b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:41.083895 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-9c7f7697-65cc-467d-a143-430ae923226b admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:41.084316 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-9c7f7697-65cc-467d-a143-430ae923226b admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:41.120100 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-9c7f7697-65cc-467d-a143-430ae923226b admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.173403 Jan 10 12:45:41.121485 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 36/71] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jan 10 12:45:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:45:42.676530 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:42.677548 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jan 10 12:45:42.677943 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:45:42.883180 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-4be5b48b-201e-4cea-97cc-3816f5f17920 admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:42.884925 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:45:42.884925 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: warnings.warn(msg) Jan 10 12:45:42.886454 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-4be5b48b-201e-4cea-97cc-3816f5f17920 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:42.886889 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-4be5b48b-201e-4cea-97cc-3816f5f17920 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:42.887732 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-4be5b48b-201e-4cea-97cc-3816f5f17920 admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:42.888156 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-4be5b48b-201e-4cea-97cc-3816f5f17920 admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:42.912468 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-4be5b48b-201e-4cea-97cc-3816f5f17920 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093307 Jan 10 12:45:42.913235 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 37/73] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jan 10 12:45:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:45:54.918625 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:54.919658 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 10 12:45:54.920053 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:45:55.123580 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-0dd88e37-83ae-4486-b574-afd4af5344bc admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:55.125192 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:45:55.125192 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: warnings.warn(msg) Jan 10 12:45:55.127428 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0dd88e37-83ae-4486-b574-afd4af5344bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:55.128022 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0dd88e37-83ae-4486-b574-afd4af5344bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:55.129220 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0dd88e37-83ae-4486-b574-afd4af5344bc admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:55.129766 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0dd88e37-83ae-4486-b574-afd4af5344bc admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:55.155289 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-0dd88e37-83ae-4486-b574-afd4af5344bc admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093620 Jan 10 12:45:55.155878 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 38/75] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jan 10 12:45:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:45:56.707283 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: DEBUG nova.api.openstack.wsgi [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] Calling method '>' {{(pid=108691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:56.708368 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: INFO nova.api.openstack.requestlog [None req-85ad88f7-5b60-4127-9aee-008559bb7bd8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jan 10 12:45:56.708765 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: [pid: 108691|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jan 10 12:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:45:56.910666 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG nova.api.openstack.wsgi [None req-0f11a332-8059-4c44-9553-9646bc4f993a admin admin] Calling method '>' {{(pid=108690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:45:56.911823 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:45:56.911823 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: warnings.warn(msg) Jan 10 12:45:56.913342 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0f11a332-8059-4c44-9553-9646bc4f993a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:56.913791 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0f11a332-8059-4c44-9553-9646bc4f993a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:56.914590 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0f11a332-8059-4c44-9553-9646bc4f993a admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:45:56.915014 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: DEBUG oslo_concurrency.lockutils [None req-0f11a332-8059-4c44-9553-9646bc4f993a admin admin] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108690) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:45:56.936156 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: INFO nova.api.openstack.requestlog [None req-0f11a332-8059-4c44-9553-9646bc4f993a admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087770 Jan 10 12:45:56.937057 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: [pid: 108690|app: 0|req: 39/77] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jan 10 12:45:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:46:53.502624 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: Mon Jan 10 12:46:53 2022 - graceful shutdown triggered... Jan 10 12:46:53.503172 dv-cinder-master-3-iscsi devstack@n-api.service[108691]: Gracefully killing worker 2 (pid: 108691)... Jan 10 12:46:53.503588 dv-cinder-master-3-iscsi devstack@n-api.service[108690]: Gracefully killing worker 1 (pid: 108690)... Jan 10 12:46:53.505736 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 10 12:46:54.503894 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: worker 1 buried after 1 seconds Jan 10 12:46:54.503894 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: worker 2 buried after 1 seconds Jan 10 12:46:54.503894 dv-cinder-master-3-iscsi devstack@n-api.service[108689]: goodbye to uWSGI. Jan 10 12:46:54.509108 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 10 12:46:54.509987 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 10 12:46:54.514521 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 10 12:46:54.529862 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 10 12:46:54 2022] *** Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: nodename: dv-cinder-master-3-iscsi Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: machine: x86_64 Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: clock source: unix Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: pcre jit disabled Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: detected number of CPU cores: 4 Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: current working directory: / Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: detected binary path: /usr/bin/uwsgi-core Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: your processes number limit is 47680 Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: your memory page size is 4096 bytes Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: detected max file descriptor number: 2048 Jan 10 12:46:54.534252 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: lock engine: pthread robust mutexes Jan 10 12:46:54.535914 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: thunder lock: enabled Jan 10 12:46:54.535914 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 10 12:46:54.535914 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 10 12:46:54.587202 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: Python main interpreter initialized at 0x56161d4ce9c0 Jan 10 12:46:54.587202 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: python threads support enabled Jan 10 12:46:54.587202 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: your server socket listen backlog is limited to 100 connections Jan 10 12:46:54.587202 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: your mercy for graceful operations on workers is 90 seconds Jan 10 12:46:54.587716 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: mapped 403077 bytes (393 KB) for 2 cores Jan 10 12:46:54.587716 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: *** Operational MODE: preforking *** Jan 10 12:46:54.587946 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: *** uWSGI is running in multiple interpreter mode *** Jan 10 12:46:54.587946 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: spawned uWSGI master process (pid: 123127) Jan 10 12:46:54.588172 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 10 12:46:54.588726 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: spawned uWSGI worker 1 (pid: 123137, cores: 1) Jan 10 12:46:54.589246 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: spawned uWSGI worker 2 (pid: 123138, cores: 1) Jan 10 12:46:54.589533 dv-cinder-master-3-iscsi devstack@n-api.service[123127]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 10 12:46:56.514307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:46:56.514307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: from cryptography.utils import int_from_bytes Jan 10 12:46:56.515036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:46:56.515036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: from cryptography.utils import int_from_bytes Jan 10 12:46:56.516780 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:46:56.516780 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: from cryptography.utils import int_from_bytes Jan 10 12:46:56.517311 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:46:56.517311 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: from cryptography.utils import int_from_bytes Jan 10 12:46:58.937299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 12:46:58.937942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 12:46:58.937942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 12:46:58.938491 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 12:46:58.938857 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 12:46:58.939015 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 12:46:58.939397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 12:46:58.939734 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 12:46:58.939841 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 12:46:58.942477 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 12:46:58.942616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.942702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.942702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.942702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.942909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.942995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.942995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.943903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.944053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.944163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.944401 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.944507 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.944773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.944876 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.945029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.945211 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.945306 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947140 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947408 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947794 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947874 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.947874 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.948224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.948566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.951315 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.951585 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.951756 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.951908 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.952062 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.952215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.952362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.952509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.952658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.952799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.952949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.953088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.953234 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.953384 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.953611 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.953845 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.954175 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.954622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.954777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.954946 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.955260 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.957798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.957954 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958226 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958481 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958800 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958873 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.958943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959363 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959501 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959739 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959994 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.959994 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.960136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.960378 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.960657 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.960754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.960994 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.961201 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.961316 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.961501 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.961640 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.961834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.962164 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.962285 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.962480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.962630 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.962803 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.963139 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.963272 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.963455 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.963659 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.963807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.964067 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.964225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.964379 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.964529 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.964665 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.964976 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.965117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.965299 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.965471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.965616 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.965949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.966142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.966307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.966438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.966643 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.966823 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.966958 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.967218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.967411 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.967598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.967776 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.967924 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.968171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.968314 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.968516 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.968659 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.968843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.969101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.969283 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.969419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.969561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.969795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.969996 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.970145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.970363 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.970557 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.970733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.970887 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.971026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.971275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.971419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.971595 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.971725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.971940 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.972156 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.972307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.972451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.972588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.972862 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.973067 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.973288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.973704 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.973896 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.973896 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.974194 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.974330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.974465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.974599 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.974821 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.974959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.975207 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.975348 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.975558 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.975765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.975912 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.976191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.976342 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.976480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.976632 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.976760 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.976947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.977134 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.977272 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.977560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.977696 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.977874 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.978049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.978204 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.978473 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.978706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.978853 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.978987 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.979135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.979427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.979591 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.979765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.979910 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.980091 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.980315 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.980450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.980717 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.980852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.981045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.981236 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.981387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.981652 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.981789 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.982014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.982152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.982287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.982575 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.982712 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.982938 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.983086 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.983219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.983454 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.983648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.983908 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.984052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.984263 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.984392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.984581 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.984863 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.985008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.985287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.985433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.985576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.985713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.985849 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.986059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.986427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.986427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.986678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.986818 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.986945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.987076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.987374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.987578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.987768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.987907 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.988099 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.988278 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.988428 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.989027 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.989163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.989635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.989868 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.990001 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.990308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.990445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.990650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.990787 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.990978 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.991197 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.991327 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.991656 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.991807 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.991990 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.992130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.992323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.992563 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.992693 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.993022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.993162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.993299 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.993424 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.993612 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.993858 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.993987 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.994255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.994396 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.994598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.994759 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.994977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.995187 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.995342 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.995605 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.995954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.996091 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.996357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.996504 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.996739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.996876 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.997002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.997240 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.997370 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.997564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.997742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.997871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.998184 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.998322 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.998531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.998666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.998935 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.999085 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.999220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.999492 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:58.999666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.999859 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:58.999988 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.000184 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.000409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.000542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.000806 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.000938 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.001118 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.001300 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.001446 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.001737 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.001884 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.002062 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.002232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.002399 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.002665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.002813 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.003049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.003259 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.003398 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.003616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.003746 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.003982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.004200 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.004481 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.004621 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.004837 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.005133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.005283 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.005466 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.005616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.005829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.006017 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.006148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.006495 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.006639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.006781 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.007001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.007131 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.007333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.007470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.007693 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.007853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.007983 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.008280 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.008420 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.008609 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.008736 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.009051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.009199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:46:59.009960 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.010163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.010250 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.010326 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.010480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.010567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.010657 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.011574 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.011781 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.012036 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.012201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.012356 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.012513 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.012682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.012827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.012827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.013114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.013904 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.014082 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.014236 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.014388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.014532 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.014673 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.014824 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.014982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.015146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.015374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.015549 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.015699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.015876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.016120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.016280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.016425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.016593 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.016817 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.016990 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.017238 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.017385 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.017528 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.017681 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.017832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.017987 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.018130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.018272 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.018413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.018554 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.018702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.018861 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.019005 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.019435 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.019614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.020039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.020212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.020361 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.020503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.020646 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.020795 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.020937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.021087 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.021239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.021382 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.021567 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.021716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.021860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.022046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.022271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.022428 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.022571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.022713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.022713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.022994 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.023146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.023289 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.023439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.023638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.023794 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.023962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.024189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.024345 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.024500 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.024652 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.024809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.024952 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.025135 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.025282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.025506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.025655 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.025807 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.025950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.026119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.026368 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.026515 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.026658 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.026831 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.027054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.027221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.027462 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.027677 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.027822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.027977 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.028126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.028276 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.028418 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.028578 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.028732 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.028874 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.029015 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.029173 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.029452 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.029606 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.029765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.029918 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.030075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.030221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.030369 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.030522 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.030678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.030821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.030962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.031113 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.031264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.031406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.031577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.031737 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.031889 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.032039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.032182 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.032485 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.032485 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.032791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.032943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033086 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033228 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033383 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033528 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033669 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033820 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033964 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.033964 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.034326 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.034326 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.034625 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.034776 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.034919 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.034919 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.035197 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.035709 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.035949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.036107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.036259 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.036516 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.036665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.036665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.036944 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.037195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.037343 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.037512 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.037743 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.037898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038200 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038359 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038512 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038813 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.038963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.039255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.039638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.039791 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.039933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.040075 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.040219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.040385 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.040539 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.040683 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.040823 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.040965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.041106 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.041268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.041411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.041561 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.041712 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.041855 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.042004 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.042221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.042367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.042603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.042758 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.042943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.043089 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.043242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.043411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.043583 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.043731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.043880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.044032 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.044174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.044333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.044552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.044699 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.044851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.045002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.045154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.045304 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.045466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.045619 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.045762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.045930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.046149 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.046304 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.046446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.046700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.046700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.046994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.046994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.047345 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.047345 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.047678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.047919 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.048087 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.048087 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.048356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.048356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.048642 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.048798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.048941 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.049082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.049230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.049372 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.049663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.049829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.049981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.050124 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.050272 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.050272 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.050542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.050707 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.050860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.051031 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.051186 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.051329 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.051611 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.051788 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.051932 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.052074 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.052215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.052357 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.052357 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.052730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.052881 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.053022 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.053174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.053317 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.053468 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.053645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.053801 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.053945 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.054095 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.054245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.054399 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.054559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.054775 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.054932 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.055082 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.055224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.055375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.055534 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.055681 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.055834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.055977 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.056156 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.056366 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.056519 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.056678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.056915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.057062 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.057250 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.057505 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.057654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.057805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.057993 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.058232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.058389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.058539 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.058689 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.058840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.058983 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.059126 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.059267 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.059407 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.059731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.059897 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.060049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.060213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.060367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.060515 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.060658 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.060808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.060950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.061092 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.061588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.061733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.061902 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.062177 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.062341 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.062619 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.062619 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.063098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.063943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.064103 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.064255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.064414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.064567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.064769 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.064983 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.065138 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.065282 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.065451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.065603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.065753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.065753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.066028 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.066181 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.066346 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.066836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.067215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.067376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.067551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.067797 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.067952 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.068107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.068270 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.068530 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.068686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.068848 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.069001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.069153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.069303 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.069453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.069686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.070017 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.070169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.070326 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.070484 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.070640 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.070798 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.070948 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.071100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.071251 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.071395 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.071602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.071799 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.071947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.072096 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.072245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.072399 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.072548 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.072769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.072769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.073160 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.073160 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.073430 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.073571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.073729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.073873 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.074013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.074163 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.074163 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.074518 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.074670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.074814 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.075076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.075318 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.075470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.075656 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.075808 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.075960 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.076111 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.076254 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.076724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.076894 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.077052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.077215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.077465 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.077620 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.077941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.078110 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.078262 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.078414 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.078686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.078793 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.078892 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.078986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079168 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079281 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079548 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.079954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080050 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080399 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080496 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080589 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080767 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.080937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081032 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081118 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081209 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081646 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081738 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081828 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.081920 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082004 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082185 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082517 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082517 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082688 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082865 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.082955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083071 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083172 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083266 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083266 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083506 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083862 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.083954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084426 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084512 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084693 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.084963 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.085065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.085158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.085246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.085246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.085417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.085417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.085576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086320 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086510 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086606 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086808 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.086986 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087068 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087766 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.087934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088018 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088287 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088287 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088444 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088528 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088616 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088723 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.088997 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089086 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089177 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089499 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089586 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089668 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089758 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089842 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.089939 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090176 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090515 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090609 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090701 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090883 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.090967 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091233 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091344 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.091986 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.092078 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.092309 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.092400 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.092649 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.092741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.092959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.093048 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.093273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.093362 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.093587 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.093688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.093897 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.093996 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.094216 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.094305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.094524 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.094626 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.094835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.094933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.095145 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.095243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.095453 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.095570 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.095792 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.095884 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.096121 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.096222 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.096435 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.096524 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.096745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.096836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.097055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.097155 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.097365 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.097465 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.097714 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.097803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.098322 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.098424 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.098692 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.098850 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.099004 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.099180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.099329 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.099496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.099713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.099947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.100040 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.100271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.100371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.100596 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.100695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.100906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.100995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.101249 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.101354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.101579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.101741 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.101900 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.102113 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.102213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.102439 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.102763 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.103098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.103358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.103464 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.103678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.103776 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.104005 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.104098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.104328 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.104409 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.104660 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.104755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.104990 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.105069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.105368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.105460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.105629 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.105715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.105947 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.106063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.107419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.107595 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.107695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.107795 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.107795 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.107975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108125 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108205 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108707 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108799 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108883 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.108965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.109210 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.109314 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.109523 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.109612 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.109840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.109937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.110152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.110257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.110468 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.110565 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.110782 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.110871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.111093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.111196 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.111410 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.111509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.112448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.112568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.112659 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.112743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.112826 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.112913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.112987 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.113064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.113149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.113222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.113322 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.113701 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.113885 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.114291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.114558 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.114801 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.115133 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.115225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.115470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.115637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.115820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.115935 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.116136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.116226 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.116484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.116639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.116918 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.117471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.117666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.117831 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.117997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.118174 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.118311 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.118512 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.118631 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.118856 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.119020 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.119200 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.119301 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.119552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.119987 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.120104 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.120330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.120448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.120648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.120740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.120956 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.121060 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.121273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.121371 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.121588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.121693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.121908 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.122016 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.122224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.122332 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.122542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.122647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.122856 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.123031 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.123195 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.123361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.123569 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.123666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.123834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.124000 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.124149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.124331 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.124482 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.124661 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.124802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.124973 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.125122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.125293 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.125436 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.125605 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.125836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.125924 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.126141 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.126244 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.126412 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.126730 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.126855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.126946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.127092 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.127360 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.127469 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.127753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.127859 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.128077 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.128166 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.128422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.128520 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.128771 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.128972 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.129148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.129419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.129747 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.129837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.130075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.130174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.130404 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.130514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.130734 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.130835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.131051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.131150 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.131392 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.131495 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.131724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.131828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.132095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.132196 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.132650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.132986 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.133339 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.133447 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.133678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.133831 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.134004 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.134142 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.134330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.134443 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.134744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.135001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.135102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.135328 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.135422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.135703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.135826 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.136023 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.136126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.136336 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.136450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.136669 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.136768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.136982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.137074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.137329 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.137476 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.137637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.137732 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.137967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.138060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.138300 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.138466 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.138613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.138706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.138946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.139039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.139293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.139635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.139779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.139963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.140056 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.140288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.140394 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.140610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.140704 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.140933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.141037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.141251 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.141353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.141574 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.141673 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.141895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.141995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.142216 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.142350 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.142533 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.142675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.142854 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.142946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.143176 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.143272 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.143528 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.143623 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.143872 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.143975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.144201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.144292 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.144514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.144626 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.144967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.145090 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.145289 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.145381 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.145606 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.145831 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.145923 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.146157 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.146258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.146503 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.146638 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.146819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.146917 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.147135 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.147235 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.147450 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.147624 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.147803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.147911 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.148116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.148218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.148444 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.148537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.148763 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.148866 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.149072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.149173 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.149384 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.149476 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.149694 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.149819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.150026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.150118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.150336 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.150437 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.150672 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.150857 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.150972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.151062 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.151280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.151385 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.151654 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.151852 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.151976 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.152220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.152319 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.152551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.152739 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.152888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.152982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.153225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.153360 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.153551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.153654 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.153867 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.153967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.154188 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.154287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.154504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.154609 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.154818 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.154912 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.155146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.155257 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.155465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.155571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.155815 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.155931 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.156149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.156387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.156493 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.156725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.156833 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.157049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.157191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.157372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.157475 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.157685 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.157809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.158004 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.158095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.158325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.158427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.158640 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.158765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.158955 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.159073 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.159271 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.159387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.159608 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.159719 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.159925 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.160025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.160240 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.160354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.160596 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.160888 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.161054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.161278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.161510 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.161686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.161862 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.162033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.162205 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.162371 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.162694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.162856 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.163025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.163167 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.163268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.163268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.163560 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.163731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.163887 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.164089 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.164211 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.164418 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.164531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.164742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.164875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.165623 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.165735 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.165823 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.165908 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.165991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.166074 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.166157 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.166255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.166390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.166479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.166691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.166784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.167013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.167126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.167346 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.167598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.167715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.168006 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.168116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.168344 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.168438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.168661 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.168751 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.168981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.169088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.169354 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.169514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.169670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.169836 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.169986 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.170175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.170323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.170505 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.170647 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.170836 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.170970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.171158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.171293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.171484 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.171638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.171852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.171955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.172165 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.172257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.172474 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.172572 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.172790 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.172892 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.173106 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.173208 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.173417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.173551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.173745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.173853 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.174061 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.174154 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.174373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.174472 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.174699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.174792 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.175014 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.175113 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.175396 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.175572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.175744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.175932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.176234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.176350 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.176570 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.176703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.176881 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.177010 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.177232 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.177559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.177700 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.177877 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.177986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.178221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.178327 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.178539 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.178636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.178853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.178947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.179178 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.179320 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.179502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.179640 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.179839 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.179933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.180151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.180259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.180469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.180561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.180791 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.180884 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.181101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.181245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.181418 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.181525 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.181729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.181822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.182064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.182164 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.182379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.182485 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.182694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.182794 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.183008 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.183100 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.183328 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.183430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.183667 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.183762 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.183980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.184072 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.184293 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.184475 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.184604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.184697 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.184920 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.185012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.185229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.185365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.185543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.185706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.185854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.186031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.186170 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.186721 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.186844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.187052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.187153 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.187427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.187565 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.187722 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.187825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.188067 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.188160 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.188388 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.188495 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.188711 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.188810 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.189029 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.189122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.189350 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.189440 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.189667 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.189760 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.189981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.190071 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.190319 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.190410 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.190644 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.190742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.190959 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.191266 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.191416 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.191631 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.191754 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.191967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.192060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.192291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.192394 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.192615 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.192715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.192954 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.193052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.193267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.193369 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.193578 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.193670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.193898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.193995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.194215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.194323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.194534 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.194642 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.194849 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.194942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.195164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.195264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.195480 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.195647 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.195836 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.195939 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.196154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.196254 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.196468 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.196560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.196783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.196884 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.197102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.197225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.197451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.197580 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.197839 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.197967 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.198106 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.198244 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.198422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.198514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.198674 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123138) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 12:46:59.198776 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.199052 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.199367 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.199712 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.200031 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.200354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.200692 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.201014 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.201325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.201752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.202072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.202400 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.202729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.203046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.203372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.203724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.204042 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.204373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.204690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.205024 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.205371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.205706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.206036 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.206347 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.206658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.206968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.207331 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.207797 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.208040 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.208361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.208687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.209010 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.209338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.209651 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.209978 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.210302 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.210622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.210939 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.211276 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.211675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.211942 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.212262 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.212577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.212891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.213207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.213539 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.213872 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.214182 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.214509 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.214831 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.215155 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.215477 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.215817 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.216152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.216470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.216793 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.217564 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.217889 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.218093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.218425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.218763 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.219094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.219426 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.219787 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.220146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.220470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.220821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.221158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.221479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.221827 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.222005 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.222116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:46:59.222341 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 12:46:59.245732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_db.sqlalchemy.engines [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.289461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.context [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03a79a3-f043-4ae0-9ae4-2ca83e1a8894(cell1) {{(pid=123138) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 12:46:59.293799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:46:59.295459 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:46:59.296294 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:46:59.298293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:46:59.309331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.310722 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.316352 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.context [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d03a79a3-f043-4ae0-9ae4-2ca83e1a8894(cell1) {{(pid=123137) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 12:46:59.320807 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:46:59.322467 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:46:59.323281 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:46:59.325324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:46:59.343413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_db.sqlalchemy.engines [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.344297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_db.sqlalchemy.engines [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.476546 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123138) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.506517 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_db.sqlalchemy.engines [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:46:59.809923 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: WARNING keystonemiddleware.auth_token [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:46:59.817687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: WARNING keystonemiddleware.auth_token [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:46:59.854531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: WARNING keystonemiddleware.auth_token [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:46:59.861413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: WARNING keystonemiddleware.auth_token [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:47:00.169424 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: WARNING keystonemiddleware.auth_token [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:47:00.174769 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: WARNING keystonemiddleware.auth_token [None req-2ed38294-c668-4f44-92e5-b3413a40286e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:47:00.180440 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56161d4ce9c0 pid: 123138 (default app) Jan 10 12:47:00.222288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: WARNING keystonemiddleware.auth_token [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 12:47:00.228314 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: WARNING keystonemiddleware.auth_token [None req-6f7373fd-274d-4a6b-88b3-e57b8526c31b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 12:47:00.233745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56161d4ce9c0 pid: 123137 (default app) Jan 10 12:47:36.305667 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1251242586", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "49875016-4f0b-4a71-9be4-5256b69fc5a3"}]}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:47:37.133941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] validate_networks() for [('49875016-4f0b-4a71-9be4-5256b69fc5a3', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:47:37.850627 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5c24cd42-a1df-4522-a2de-1e4f13c4da8b tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcc61c700>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:38.284698 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5c24cd42-a1df-4522-a2de-1e4f13c4da8b tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/48ec88d7-9ced-467d-80da-2429fa087d83" status: 200 len: 351 microversion: 2.1 time: 0.995491 Jan 10 12:47:38.285615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:47:37 2022] GET /compute/v2.1/os-volumes/48ec88d7-9ced-467d-80da-2429fa087d83 => generated 351 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:47:38.667229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1548450505", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "0493530f-49b3-4527-b75d-6de75567c16c"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:47:38.926717 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] validate_networks() for [('0493530f-49b3-4527-b75d-6de75567c16c', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:47:39.598905 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:47:39.600358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:47:39.600984 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:47:39.601763 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:47:39.602384 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:47:39.647334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:39.649664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:39.650777 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:39.656503 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:39.746298 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Getting quotas for project 30d54bc5b800487db219940267292ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:47:39.762497 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Getting quotas for user 5883f052c7b64d74b361cd1c8f689061 and project 30d54bc5b800487db219940267292ed4. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:47:39.783866 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:47:39.792817 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:47:39.958382 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1d8ff08c-28d8-4017-a0fa-ce4badf3fec0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.172894 Jan 10 12:47:39.959035 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:47:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 5175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:47:39.977095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-171c22c6-55c0-4b44-87a9-2c67cc7257c8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:39.980841 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-171c22c6-55c0-4b44-87a9-2c67cc7257c8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:40.193370 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-171c22c6-55c0-4b44-87a9-2c67cc7257c8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:40.214982 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-171c22c6-55c0-4b44-87a9-2c67cc7257c8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1215 microversion: 2.1 time: 0.246308 Jan 10 12:47:40.215607 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:39 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:40.231062 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d471e7ff-5076-49fd-8965-e54ad5efa3eb tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcbbcb8b0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:40.377313 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d471e7ff-5076-49fd-8965-e54ad5efa3eb tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/58e862a3-d17f-4054-8b67-47ca1e3a3c4b" status: 200 len: 350 microversion: 2.1 time: 0.151787 Jan 10 12:47:40.378367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:47:40 2022] GET /compute/v2.1/os-volumes/58e862a3-d17f-4054-8b67-47ca1e3a3c4b => generated 350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:47:40.848391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:47:40.849503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:47:40.850161 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:47:40.851209 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:47:40.852011 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:47:40.889221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:40.889679 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:40.890505 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:40.890946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:40.968157 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:47:40.977238 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for user 0513eaec53d241f398508dec85f017d7 and project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:47:41.005282 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:47:41.010385 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:47:41.175628 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d34a90ba-0790-475b-bed7-ba848225963a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.663355 Jan 10 12:47:41.177642 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 2/5] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:47:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 12:47:41.193523 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c7dd74e9-0741-4a82-ad94-a39106ac819f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:41.194870 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c7dd74e9-0741-4a82-ad94-a39106ac819f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:41.239992 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4dfc4a57-becb-4913-aeb0-31a0fbcbce73 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:41.240980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4dfc4a57-becb-4913-aeb0-31a0fbcbce73 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:41.483900 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4dfc4a57-becb-4913-aeb0-31a0fbcbce73 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:41.484825 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c7dd74e9-0741-4a82-ad94-a39106ac819f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:41.499671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c7dd74e9-0741-4a82-ad94-a39106ac819f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1218 microversion: 2.1 time: 0.316571 Jan 10 12:47:41.504966 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4dfc4a57-becb-4913-aeb0-31a0fbcbce73 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1215 microversion: 2.1 time: 0.271560 Jan 10 12:47:41.513043 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:41 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1218 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:41.516856 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 3/7] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:41 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:47:42.042949 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-726afa15-ac41-4f49-a21e-5700787d2457 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb369dc0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:42.138644 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-726afa15-ac41-4f49-a21e-5700787d2457 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ba686e90-4ee3-460a-ae86-9f859e75aac9" status: 200 len: 350 microversion: 2.1 time: 0.111959 Jan 10 12:47:42.139255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 5/8] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:47:42 2022] GET /compute/v2.1/os-volumes/ba686e90-4ee3-460a-ae86-9f859e75aac9 => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:47:42.151184 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-acaf0f73-c6fd-4419-89ce-45a42aa3f277 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb350790>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:42.274033 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-acaf0f73-c6fd-4419-89ce-45a42aa3f277 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.126679 Jan 10 12:47:42.274616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 4/9] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jan 10 12:47:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:42.288587 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1dd8c271-cd5d-42a8-a7d5-26e664d9e0b1 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb371670>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:42.488826 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1dd8c271-cd5d-42a8-a7d5-26e664d9e0b1 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.203835 Jan 10 12:47:42.489409 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1148 bytes} [Mon Jan 10 12:47:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:47:42.501472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7ff910fa-6b61-41a7-bb40-0070c550d9a0 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb363d30>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:42.518405 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-faa91b79-6a38-4305-99e3-3cf2f19fa9ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:42.519323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-faa91b79-6a38-4305-99e3-3cf2f19fa9ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:42.607858 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-faa91b79-6a38-4305-99e3-3cf2f19fa9ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:42.614957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-faa91b79-6a38-4305-99e3-3cf2f19fa9ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1218 microversion: 2.1 time: 0.102022 Jan 10 12:47:42.616540 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 7/11] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:42 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:42.623375 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:42.629636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:42.644302 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:42.648210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:42.649470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:42.650147 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:42.677616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7ff910fa-6b61-41a7-bb40-0070c550d9a0 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.179647 Jan 10 12:47:42.678331 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 5/12] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jan 10 12:47:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:42.690963 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a3c9d303-52a3-454d-8477-ddcb8e98137a tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb363dc0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:42.877622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a3c9d303-52a3-454d-8477-ddcb8e98137a tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.190579 Jan 10 12:47:42.878344 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Jan 10 12:47:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:47:43.030175 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:43.043143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-566e8b61-0b87-45e1-9a7e-3b38a5be122b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1219 microversion: 2.1 time: 0.423215 Jan 10 12:47:43.043820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 8/14] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:42 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1219 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:43.067805 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-108e140e-3c58-4c96-8bc2-38295ac698a5 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb369d30>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:43.074442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cc69446a-4ec7-46a9-b7e9-724e544f43d8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'create', calling method: .version_select at 0x7f7fcce38040>, body: {"keypair": {"name": "tempest-keypair-931598735"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:47:43.105314 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-cc69446a-4ec7-46a9-b7e9-724e544f43d8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:47:43.111260 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-cc69446a-4ec7-46a9-b7e9-724e544f43d8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for user 8c5ac449d0494ab585c0aeccb9541016 and project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:47:43.337460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-108e140e-3c58-4c96-8bc2-38295ac698a5 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.292564 Jan 10 12:47:43.338046 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 9/15] 10.222.0.13 () {58 vars in 1169 bytes} [Mon Jan 10 12:47:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:47:43.356000 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cb219c55-0a1f-4862-a622-d369d7450e13 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb2e7d30>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:43.512585 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cb219c55-0a1f-4862-a622-d369d7450e13 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.161309 Jan 10 12:47:43.513417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 10/16] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jan 10 12:47:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:43.527599 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4ceac2f3-b13f-4049-85dd-d800a942f050 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb2d4b80>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:43.692979 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-cc69446a-4ec7-46a9-b7e9-724e544f43d8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:47:43.704125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-cc69446a-4ec7-46a9-b7e9-724e544f43d8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for user 8c5ac449d0494ab585c0aeccb9541016 and project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:47:43.749421 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cc69446a-4ec7-46a9-b7e9-724e544f43d8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.869944 Jan 10 12:47:43.750068 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 7/17] 10.222.0.13 () {62 vars in 1198 bytes} [Mon Jan 10 12:47:42 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 871 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 10 12:47:43.755917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:43.756135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4ceac2f3-b13f-4049-85dd-d800a942f050 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.232957 Jan 10 12:47:43.757033 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:43.757222 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 11/18] 10.222.0.13 () {58 vars in 1187 bytes} [Mon Jan 10 12:47:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:47:43.772463 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d694dec7-d82f-4c9b-89a6-409c0f711766 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] Calling method '.version_select at 0x7f7fcb2f4940>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:43.774660 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:43.775466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:43.776557 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:43.777230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:43.985829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d694dec7-d82f-4c9b-89a6-409c0f711766 tempest-VolumesTestJSON-1134233563 tempest-VolumesTestJSON-1134233563-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.217715 Jan 10 12:47:43.986483 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 12/19] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jan 10 12:47:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:47:44.061299 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:44.062345 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:44.070652 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:44.071460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:44.072661 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:44.073524 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:44.144378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:44.156380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-30922fbe-6378-48dc-b1c0-87b22515a403 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1222 microversion: 2.1 time: 0.404917 Jan 10 12:47:44.157061 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 8/20] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:43 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1222 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:44.290976 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:44.313207 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e3e291f0-978c-411a-9e25-f066cb418e16 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1219 microversion: 2.1 time: 0.247660 Jan 10 12:47:44.314201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 13/21] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:44 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:45.174997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:45.176769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:45.183923 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:45.184735 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:45.185767 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:45.186806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:45.333385 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:45.342851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:45.353996 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:45.354452 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:45.355251 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:45.355755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:45.510244 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:45.522844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-47f12e8a-21ea-443f-9f48-1b3d87970408 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1214 microversion: 2.1 time: 0.353002 Jan 10 12:47:45.523472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 9/22] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:45 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:45.529276 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:45.537339 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ba2fbed9-9a0d-45d8-ad1c-5645ff8316ed tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1211 microversion: 2.1 time: 0.210094 Jan 10 12:47:45.539543 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 14/23] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:45 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1211 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:46.540729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:46.541426 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:46.557860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:46.558695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:46.563758 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:46.565006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:46.568854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:46.570829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:46.572178 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:46.578827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:46.581203 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:46.584317 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:47.151687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:47.170087 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-df067f94-c8b5-4bf2-b90a-15e1b5de6661 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1273 microversion: 2.1 time: 0.608944 Jan 10 12:47:47.174082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 15/24] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:46 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1273 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:47:47.234758 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:47.254721 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c07a37f1-3895-4b87-bf87-64ce78e96a24 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1270 microversion: 2.1 time: 0.718201 Jan 10 12:47:47.274154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 10/25] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:46 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1270 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:47.410542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-445587871", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4e2bf48-1c7a-42e2-945e-96cdb90a357a"}], "security_groups": [{"name": "tempest-securitygroup--340475269"}], "key_name": "tempest-keypair-931598735", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:47:47.679443 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] validate_networks() for [('e4e2bf48-1c7a-42e2-945e-96cdb90a357a', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:47:48.189177 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:48.190281 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:48.210381 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:48.210837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:48.211687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:48.212132 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:49.301372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:49.326146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6b317315-ec5b-4288-9210-475073fa653b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1273 microversion: 2.1 time: 1.141372 Jan 10 12:47:49.336430 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 11/26] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:48 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1273 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:47:49.338185 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:49.343702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:49.364480 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:49.365009 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:49.365823 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:49.368205 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:49.752449 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:49.766449 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-98a653b6-4b87-46ac-91be-a6c6d27a9276 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1276 microversion: 2.1 time: 0.431796 Jan 10 12:47:49.770197 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 12/27] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:49 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1276 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:49.871108 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:47:49.872636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:47:49.874255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:47:49.875059 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:47:49.875660 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:47:49.902772 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:49.903264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:49.904129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:49.904560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:49.945885 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:47:49.965578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for user 8c5ac449d0494ab585c0aeccb9541016 and project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:47:49.997710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:47:50.000555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:47:50.116670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e112aca4-1992-4ecf-9d34-4736f5fbb66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.712744 Jan 10 12:47:50.117843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 16/28] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jan 10 12:47:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 10 12:47:50.131000 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6a0a6d9e-c1a5-467f-a371-ffcdbdafe9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:50.132686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6a0a6d9e-c1a5-467f-a371-ffcdbdafe9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:50.268416 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a0a6d9e-c1a5-467f-a371-ffcdbdafe9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:50.288786 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a0a6d9e-c1a5-467f-a371-ffcdbdafe9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:50.304117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a0a6d9e-c1a5-467f-a371-ffcdbdafe9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:50.311970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6a0a6d9e-c1a5-467f-a371-ffcdbdafe9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1280 microversion: 2.20 time: 0.183481 Jan 10 12:47:50.315377 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 17/29] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:47:50 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1280 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:47:50.344784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:50.345269 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:50.387014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:50.387390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:50.391773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:50.394657 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:50.686829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:50.698291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1164a442-5934-44aa-a078-31b25f9dd1b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1273 microversion: 2.1 time: 0.359181 Jan 10 12:47:50.712574 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 18/30] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:50 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:47:50.786739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:50.787385 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:50.805064 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:50.805519 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:50.806530 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:50.808596 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:50.829428 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1856813594", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "497213e1-63f6-4b0c-9b64-5f0e17031989"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:47:51.025675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] validate_networks() for [('497213e1-63f6-4b0c-9b64-5f0e17031989', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:47:51.334716 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:51.343239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-45a7c162-285e-42f8-899b-e3ff09d8abc0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.560534 Jan 10 12:47:51.347123 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 19/31] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:50 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:47:51.358790 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:51.364823 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:51.381684 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:51.385839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:51.386910 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:51.392564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:51.558522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:51.568219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:51.582710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:51.586403 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f11eb7eb-5c40-48a3-afbc-5f3f522b15ae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1284 microversion: 2.20 time: 0.237243 Jan 10 12:47:51.590177 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 20/32] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:47:51 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:47:51.716414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:51.717440 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:51.728778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:51.736790 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:51.739078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:51.740136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:52.640082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:52.656184 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9fcbe2cf-3047-40b8-b1e2-6fe4527d6cf0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.944838 Jan 10 12:47:52.660849 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 21/33] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:51 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:52.679703 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:52.685381 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:52.714028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:52.717233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:52.718936 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:52.722995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:53.193736 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:47:53.194603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:47:53.194685 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:47:53.195062 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:47:53.195880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:47:53.219957 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:53.222009 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:53.228375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:53.231464 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:53.384168 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Getting quotas for project de46aa3bf673456885b6c388c16c901b. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:47:53.401114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Getting quotas for user c7c2b5d01a124f3e94bc557b641f77a1 and project de46aa3bf673456885b6c388c16c901b. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:47:53.457906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:47:53.465928 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:47:53.523532 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:53.538831 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-06ccc42e-9b3d-46ab-bc89-a86cb8f85cab tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.870644 Jan 10 12:47:53.542020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 22/34] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:52 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:53.566069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:53.567214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:53.588967 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:53.596301 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:53.600190 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:53.601863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:53.618264 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-adc2bb1d-92b6-4dbc-88f0-1a80f163c651 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.843752 Jan 10 12:47:53.620499 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 13/35] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:47:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:47:53.641329 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f84ef6aa-12da-4b16-9688-304e4d8aa40f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:53.645041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f84ef6aa-12da-4b16-9688-304e4d8aa40f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:53.808515 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:53.826584 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:53.833836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:53.838807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-dc9665b6-119e-492a-81e7-7f7d6ab45cbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1338 microversion: 2.20 time: 0.293880 Jan 10 12:47:53.842625 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 23/36] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:47:53 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1338 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:47:53.853936 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:53.858554 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:53.868819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:53.869628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:53.870729 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:53.871446 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:53.949838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f84ef6aa-12da-4b16-9688-304e4d8aa40f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:53.959305 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f84ef6aa-12da-4b16-9688-304e4d8aa40f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1222 microversion: 2.1 time: 0.329988 Jan 10 12:47:53.965431 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 14/37] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:53 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1222 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:54.233159 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:54.247401 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7e3af5c4-568c-4117-b680-9e97595d03da tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.399029 Jan 10 12:47:54.249568 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 24/38] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:53 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:54.494866 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-75823692", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "497213e1-63f6-4b0c-9b64-5f0e17031989"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:47:54.563098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:54.564225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:54.580302 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:54.581882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:54.583867 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:54.587682 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:54.670487 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] validate_networks() for [('497213e1-63f6-4b0c-9b64-5f0e17031989', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:47:55.503531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:55.514227 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5ac76fd6-bfd3-468f-a3c6-c733cc8d0c32 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.956743 Jan 10 12:47:55.521834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 25/39] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:54 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:47:55.544036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:55.546427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:55.556517 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:55.564500 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:55.566051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:55.566685 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:55.839207 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:55.851400 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:55.856927 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:55.858480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-56fc85b5-fe4f-4f0b-bc60-81c89963ac85 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1338 microversion: 2.20 time: 0.335051 Jan 10 12:47:55.861360 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 26/40] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:47:55 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1338 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:47:55.872685 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:55.875240 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:55.897187 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:55.897829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:55.898785 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:55.899373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:56.747026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:56.763252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6aad978c-99f9-4b82-af21-c8e44c40af95 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.898921 Jan 10 12:47:56.763898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 27/41] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:55 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:56.773220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:56.779842 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:56.797878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:47:56.799250 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:47:56.800803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:47:56.801233 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:47:56.801655 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:47:56.804976 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:56.808969 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:56.813373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:56.814019 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:56.821847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:56.822743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:56.825551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:56.826280 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:56.878416 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Getting quotas for project de46aa3bf673456885b6c388c16c901b. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:47:56.904873 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Getting quotas for user c7c2b5d01a124f3e94bc557b641f77a1 and project de46aa3bf673456885b6c388c16c901b. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:47:56.919613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:47:56.923195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:47:57.025290 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-30349b86-5d55-40a2-815c-36a6d0eab8a7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.535044 Jan 10 12:47:57.027968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 15/42] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:47:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:47:57.043788 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:57.048343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:57.067928 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:57.069975 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:57.070842 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:57.073456 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:57.161873 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:57.174997 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fb65864f-19c9-4812-86c8-fa7bcc8f7ff0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.405648 Jan 10 12:47:57.184691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 28/43] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:56 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:57.191181 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e17cf248-b83d-4929-b628-ebf4ded0e03c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:57.192209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e17cf248-b83d-4929-b628-ebf4ded0e03c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:57.298567 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e17cf248-b83d-4929-b628-ebf4ded0e03c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:57.313828 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e17cf248-b83d-4929-b628-ebf4ded0e03c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1220 microversion: 2.1 time: 0.127475 Jan 10 12:47:57.325837 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 29/44] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:57 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:57.410114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:57.421397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:57.423436 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:57.424930 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1b145a8e-b4a9-42e5-9eb3-64d1dbb5dc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.394499 Jan 10 12:47:57.436369 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 16/45] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:47:57 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:47:57.783699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:57.784627 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:57.790838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:57.791729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:57.792847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:57.793902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:57.873124 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-3cb5ec65-f19a-4926-9292-f06c800080e3 req-2b7dbef4-1ab0-4384-8533-1ae35f3a6082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03af44ba-8887-46a6-8431-a348b4376790", "tag": "6c86b883-3cd7-458e-b400-d77a0e4ebea6"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:47:57.875600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:47:57.875600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:47:57.975799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-3cb5ec65-f19a-4926-9292-f06c800080e3 req-2b7dbef4-1ab0-4384-8533-1ae35f3a6082 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:57.991624 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-3cb5ec65-f19a-4926-9292-f06c800080e3 req-2b7dbef4-1ab0-4384-8533-1ae35f3a6082 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.015414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-3cb5ec65-f19a-4926-9292-f06c800080e3 req-2b7dbef4-1ab0-4384-8533-1ae35f3a6082 service nova] Creating event network-changed:6c86b883-3cd7-458e-b400-d77a0e4ebea6 for instance 03af44ba-8887-46a6-8431-a348b4376790 on hv-cinder-maste Jan 10 12:47:58.016583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-3cb5ec65-f19a-4926-9292-f06c800080e3 req-2b7dbef4-1ab0-4384-8533-1ae35f3a6082 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123138) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 10 12:47:58.018067 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c96413f9-b9da-48d2-aa87-d090eb430b17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.018961 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c96413f9-b9da-48d2-aa87-d090eb430b17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.020034 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c96413f9-b9da-48d2-aa87-d090eb430b17 None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.020625 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c96413f9-b9da-48d2-aa87-d090eb430b17 None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.031304 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.compute.rpcapi [None req-c96413f9-b9da-48d2-aa87-d090eb430b17 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 10 12:47:58.032560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c96413f9-b9da-48d2-aa87-d090eb430b17 None None] Releasing lock "compute-rpcapi-router" {{(pid=123138) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 10 12:47:58.082918 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c96413f9-b9da-48d2-aa87-d090eb430b17 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496578 Jan 10 12:47:58.084908 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 30/46] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:47:58.125187 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:58.136168 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e1249381-2c57-4a92-af71-d958b71905f8 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.357496 Jan 10 12:47:58.136630 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 17/47] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:57 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:58.194578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:58.195700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:58.224295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.226715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.229062 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.231338 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.331225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:58.331890 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:58.343383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.344821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.345733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.346157 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.493353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:58.501730 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d62aabd4-6caf-4d5b-b360-e6f9407a93a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1224 microversion: 2.1 time: 0.174674 Jan 10 12:47:58.515141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 18/48] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:58 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1224 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:58.523797 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:58.532440 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d100ec8c-4c08-4eda-a16d-02fc5392a427 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.343046 Jan 10 12:47:58.533547 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 31/49] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:58 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:58.534835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:58.535896 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:58.548502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.552700 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.554638 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:58.556163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:58.843326 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:58.866353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:58.872513 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:58.873848 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0efc4be8-1186-481a-9b57-0a8c1a848163 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.357336 Jan 10 12:47:58.878580 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 19/50] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:47:58 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:47:59.160610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:59.162261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:59.182030 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.182487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:59.183295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.183760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:59.522916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:59.523699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:59.534301 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.540600 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:59.541564 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.545378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:59.612197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:59.625359 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-902691d7-895a-4d01-ac26-5b5ffb7501a1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.476088 Jan 10 12:47:59.647244 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 32/51] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:59 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:59.677694 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:59.681373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:59.709169 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.712666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:59.718410 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.720081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:59.911540 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:47:59.931264 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cb03e07e-92d2-4721-a610-1a29e153b124 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1224 microversion: 2.1 time: 0.412713 Jan 10 12:47:59.945307 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 20/52] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:59 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1224 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:47:59.959529 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:47:59.960192 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:47:59.986162 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.986757 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:47:59.988783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:47:59.991375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:00.106772 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:00.116653 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cd37fc31-ec7b-471b-b660-3f4832f0ad2e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.473500 Jan 10 12:48:00.118999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 33/53] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:47:59 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:00.239278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-060958f2-bf5f-4ff5-9ba6-3994c86fa6a8 req-92f54466-13fd-4b16-88c4-3560bbb4e357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5293f2-dd8c-49b7-b758-6a921c8addd7", "tag": "20b9c325-c5a2-4308-bf9c-add26af27b1a"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:00.241382 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:00.241382 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:00.256358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-060958f2-bf5f-4ff5-9ba6-3994c86fa6a8 req-92f54466-13fd-4b16-88c4-3560bbb4e357 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:00.257575 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-060958f2-bf5f-4ff5-9ba6-3994c86fa6a8 req-92f54466-13fd-4b16-88c4-3560bbb4e357 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:00.276984 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-060958f2-bf5f-4ff5-9ba6-3994c86fa6a8 req-92f54466-13fd-4b16-88c4-3560bbb4e357 service nova] Creating event network-changed:20b9c325-c5a2-4308-bf9c-add26af27b1a for instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 on hv-cinder-maste Jan 10 12:48:00.293389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-060958f2-bf5f-4ff5-9ba6-3994c86fa6a8 req-92f54466-13fd-4b16-88c4-3560bbb4e357 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059447 Jan 10 12:48:00.294411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 34/54] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:00.303645 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:00.319751 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:00.321984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:00.323417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f48adec0-1747-48f6-bc2e-baf52beeceb2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.377055 Jan 10 12:48:00.325308 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 21/55] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:47:59 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:00.656676 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:00.658802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:00.670217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:00.673857 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:00.676139 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:00.676664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:00.859357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:00.869988 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-60d82b32-52bc-4aed-a8da-a8212cf96620 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.219491 Jan 10 12:48:00.881305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 35/56] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:00 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:00.949368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:00.950114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:00.958046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:00.958575 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:00.959371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:00.960027 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:01.087393 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:01.096571 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0ec97cb0-f8a1-4fd8-a289-53bf13313595 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1216 microversion: 2.1 time: 0.151620 Jan 10 12:48:01.097772 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 22/57] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:00 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:01.136431 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:01.137347 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:01.144436 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:01.145436 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:01.146340 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:01.147130 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:01.335357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:01.347594 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:01.348458 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:01.364828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:01.365291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c8e43496-67ab-491f-a21e-f2337ad1be4c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.231475 Jan 10 12:48:01.366098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 36/58] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:01 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:01.376260 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:01.377984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:01.378955 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:01.711423 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:01.724616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:01.731626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:01.739294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c6c83ec1-809e-4ff7-94ab-8d45ff3c0aae tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.390387 Jan 10 12:48:01.740044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 23/59] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:01 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:01.888247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:01.889339 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:01.906536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:01.906656 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:01.917132 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:01.920100 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.118289 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:02.119852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:02.129818 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:02.132098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.135165 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:02.136623 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.188740 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:02.231830 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5f3fb71b-c3a9-4e53-98b0-fed86e3e23e6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.343558 Jan 10 12:48:02.232806 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 37/60] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:01 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:02.265946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:02.273810 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6e2ddbe0-9727-4ba9-b3a7-5c45dc89493d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1216 microversion: 2.1 time: 0.164347 Jan 10 12:48:02.274604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 24/61] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:02 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:02.319725 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-3be47e0a-1772-4149-9756-e63f586ed86f req-16e8b4bf-be67-465b-b97b-5bc018f425a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3436ba09-022f-4b36-987d-667c236d68d1", "tag": "0341fd05-df0a-4b20-a713-82457a146a1c"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:02.321287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:02.321287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:02.328626 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-3be47e0a-1772-4149-9756-e63f586ed86f req-16e8b4bf-be67-465b-b97b-5bc018f425a6 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:02.329434 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-3be47e0a-1772-4149-9756-e63f586ed86f req-16e8b4bf-be67-465b-b97b-5bc018f425a6 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.342304 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-3be47e0a-1772-4149-9756-e63f586ed86f req-16e8b4bf-be67-465b-b97b-5bc018f425a6 service nova] Creating event network-changed:0341fd05-df0a-4b20-a713-82457a146a1c for instance 3436ba09-022f-4b36-987d-667c236d68d1 on hv-cinder-maste Jan 10 12:48:02.348045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-3be47e0a-1772-4149-9756-e63f586ed86f req-16e8b4bf-be67-465b-b97b-5bc018f425a6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033208 Jan 10 12:48:02.349103 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 38/62] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:02.385216 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:02.385901 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:02.395341 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:02.396588 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.398233 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:02.399219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.604710 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:02.623459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ce7e526f-7caa-4e8e-8b0f-36081a7edb5d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.242845 Jan 10 12:48:02.638080 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 25/63] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:02 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:02.759547 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:02.760171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:02.772799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:02.773247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.774192 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:02.774633 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:02.995788 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:03.006872 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:03.009625 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:03.011472 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a694e7e1-9945-470b-be53-edc1d662158f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.255988 Jan 10 12:48:03.025341 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 39/64] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:02 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:03.250054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:03.250667 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:03.261468 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:03.261833 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:03.262634 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:03.263097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:03.290116 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:03.290730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:03.312910 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:03.313500 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:03.314351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:03.314819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:03.471285 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:03.483641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e3556fb1-e6b4-413e-aa48-c23582975adc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1272 microversion: 2.1 time: 0.196821 Jan 10 12:48:03.485191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 40/65] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:03 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:03.648395 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:03.649461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:03.666251 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:03.668779 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:03.669916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:03.671372 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:03.673168 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:03.677335 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-332a2f56-67ab-4765-a165-aadbffbd5e01 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.430892 Jan 10 12:48:03.679999 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 26/66] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:03 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:04.034488 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:04.035486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:04.050387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:04.051101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:04.052272 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:04.053253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:04.322142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:04.333563 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-526ca180-19cc-4f7e-9685-976284bf7a6d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.690877 Jan 10 12:48:04.340220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 41/67] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:03 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:04.500377 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:04.501608 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:04.502312 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:04.509152 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:04.513788 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:04.514583 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:04.514888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:04.515461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:04.517143 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:04.519919 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-323f6649-f117-4d56-926e-a8a14209487f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.490223 Jan 10 12:48:04.533189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 27/68] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:04 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:04.612247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:04.619632 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-77476ef9-1732-4647-9ff9-0283fcfc858b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1278 microversion: 2.1 time: 0.121751 Jan 10 12:48:04.620210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 42/69] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:04 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:04.696858 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:04.697627 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:04.704951 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:04.706338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:04.708089 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:04.709121 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:04.901401 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:04.910706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e62fde08-3105-472c-8091-bb990f53c265 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.217530 Jan 10 12:48:04.911470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 28/70] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:04 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:05.357480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:05.357999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:05.367008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.367461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:05.368271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.371336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:05.540888 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:05.543318 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:05.561279 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.563219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:05.566250 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.571849 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:05.601595 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:05.609307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a5e6aeb4-167d-432c-8614-510237b8ac33 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.256279 Jan 10 12:48:05.619012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 43/71] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:05 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:05.638834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:05.639822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:05.649767 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.650495 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:05.651461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.652085 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:05.738943 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:05.746388 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9bd97e8a-1410-4309-ae08-a29e5add61f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1278 microversion: 2.1 time: 0.112679 Jan 10 12:48:05.755643 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 44/72] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:05 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:05.785402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:05.797138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:05.799342 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:05.800764 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c5efd5c6-37e5-4347-b3ab-00dfb432f8a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.265408 Jan 10 12:48:05.801878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 29/73] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:05 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:48:05.928173 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:05.929310 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:05.936919 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.937594 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:05.938648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:05.939909 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:06.128810 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:06.136844 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ef77e8f6-b04a-4ca8-a492-526edf5b50f1 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.213107 Jan 10 12:48:06.137420 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 45/74] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:05 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:06.630168 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:06.630725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:06.640035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:06.640496 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:06.641329 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:06.641752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:06.763036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:06.764308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:06.774163 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:06.775012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:06.775940 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:06.776627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:06.894667 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:06.903797 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b6b39076-d566-4e03-a67b-62a095efb278 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.278343 Jan 10 12:48:06.914101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 30/75] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:06 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:06.919214 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:06.919971 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:06.928767 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:06.929401 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:06.930358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:06.930863 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:07.113435 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:07.124026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-aa8fcd14-6541-44ff-9ad0-65db228f7438 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.364823 Jan 10 12:48:07.124957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 46/76] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:06 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:07.154039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:07.154713 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:07.162403 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:07.163112 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:07.164159 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:07.164668 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:07.293620 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:07.312511 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:07.314277 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:07.315665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4342c7fd-2a49-4269-9430-a6c9e53daa54 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.400195 Jan 10 12:48:07.316415 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 31/77] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:06 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:07.381248 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:07.413264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c515d4bf-ebd3-4123-b9e6-cf646ed60309 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.262728 Jan 10 12:48:07.414076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 47/78] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:07 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:07.920915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:07.922268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:07.928832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:07.929762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:07.931101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:07.932062 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:08.103815 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:08.111643 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9d6e0a09-4a69-420d-aabe-f77b28ab18cf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.194714 Jan 10 12:48:08.115581 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 32/79] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:07 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:08.144076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:08.144076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:08.151992 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:08.153015 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:08.154014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:08.154464 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:08.303154 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:08.311430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-544caa4a-3cd3-41dd-947f-3249f571e873 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.172418 Jan 10 12:48:08.312376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 48/80] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:08 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:08.334151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:08.334763 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:08.340813 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:08.341261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:08.342232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:08.342667 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:08.430882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:08.431761 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:08.438099 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:08.438849 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:08.439979 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:08.440589 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:08.507915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:08.518050 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:08.520544 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:08.521754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7c511711-a774-49fc-86bb-a402b9b3e6c1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.191643 Jan 10 12:48:08.533236 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 33/81] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:08 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:08.588193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:08.599285 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0c4b2140-d161-4aae-a4f6-2b405751d80b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.171598 Jan 10 12:48:08.600079 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 49/82] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:08 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:09.128337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:09.129012 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:09.139106 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.142922 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.143850 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.144294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.328466 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:09.329691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:09.336805 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.337494 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.338483 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.339079 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.346752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:09.355320 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-66ee13a5-d99a-4160-9ba5-eb8d656f634e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.230654 Jan 10 12:48:09.356655 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 34/83] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:09 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:09.511636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:09.521378 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d747ba89-31d3-4df7-9b3e-3ece57d4e069 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.196461 Jan 10 12:48:09.523264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 50/84] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:09 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:09.542802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:09.543710 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:09.552253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.553094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.554085 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.554699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.617751 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:09.618430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:09.626451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.629295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.630176 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:09.630621 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:09.786732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:09.809488 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:09.811471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:09.813076 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d079973f-8966-49b3-93ee-f717720567da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.274740 Jan 10 12:48:09.822829 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 35/85] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:09 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:10.138388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-07f846b6-5780-4707-94a6-a240da0c8198 req-6738db67-415a-435c-b2a4-8970bbebb136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7d250b-ae30-4ddc-9e68-0272505cf636", "tag": "5f9bf9f4-13cb-4777-adde-d6b21836bdff"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:10.141579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:10.141579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:48:10.175620 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-07f846b6-5780-4707-94a6-a240da0c8198 req-6738db67-415a-435c-b2a4-8970bbebb136 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.177703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-07f846b6-5780-4707-94a6-a240da0c8198 req-6738db67-415a-435c-b2a4-8970bbebb136 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.215467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:10.238602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7a5a5eab-3fd7-4192-a233-1ee26f949593 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.625846 Jan 10 12:48:10.255806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-07f846b6-5780-4707-94a6-a240da0c8198 req-6738db67-415a-435c-b2a4-8970bbebb136 service nova] Creating event network-changed:5f9bf9f4-13cb-4777-adde-d6b21836bdff for instance 7c7d250b-ae30-4ddc-9e68-0272505cf636 on hv-cinder-maste Jan 10 12:48:10.256514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-07f846b6-5780-4707-94a6-a240da0c8198 req-6738db67-415a-435c-b2a4-8970bbebb136 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 10 12:48:10.259981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7671759f-1c67-4d05-8a0c-2fbe080a29b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.260435 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7671759f-1c67-4d05-8a0c-2fbe080a29b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.265559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 51/86] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:09 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:10.266055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7671759f-1c67-4d05-8a0c-2fbe080a29b6 None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.266508 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7671759f-1c67-4d05-8a0c-2fbe080a29b6 None None] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.296524 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.compute.rpcapi [None req-7671759f-1c67-4d05-8a0c-2fbe080a29b6 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 10 12:48:10.299792 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7671759f-1c67-4d05-8a0c-2fbe080a29b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=123137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 10 12:48:10.341550 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7671759f-1c67-4d05-8a0c-2fbe080a29b6 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206876 Jan 10 12:48:10.343033 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 36/87] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:10.384881 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:10.388696 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:10.417687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.424579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.428202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.431809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.470506 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-54bd4b60-f4fe-4c3f-bc2e-5debd7064177 req-159b8121-8db8-416f-ab08-ef158e9bd992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5293f2-dd8c-49b7-b758-6a921c8addd7", "name": "network-vif-plugged", "status": "completed", "tag": "20b9c325-c5a2-4308-bf9c-add26af27b1a"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:10.496541 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:10.496541 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:10.519458 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-54bd4b60-f4fe-4c3f-bc2e-5debd7064177 req-159b8121-8db8-416f-ab08-ef158e9bd992 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.520177 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-54bd4b60-f4fe-4c3f-bc2e-5debd7064177 req-159b8121-8db8-416f-ab08-ef158e9bd992 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.551161 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-54bd4b60-f4fe-4c3f-bc2e-5debd7064177 req-159b8121-8db8-416f-ab08-ef158e9bd992 service nova] Creating event network-vif-plugged:20b9c325-c5a2-4308-bf9c-add26af27b1a for instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 on hv-cinder-maste Jan 10 12:48:10.563890 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-54bd4b60-f4fe-4c3f-bc2e-5debd7064177 req-159b8121-8db8-416f-ab08-ef158e9bd992 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249451 Jan 10 12:48:10.565058 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 52/88] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:10.582706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:10.586039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:10.600528 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.600977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.601777 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.602207 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.826367 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:10.834789 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7aedc1e3-722b-4167-b122-53b8a9f5b109 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.463755 Jan 10 12:48:10.847875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 37/89] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:10 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:10.859720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:10.860408 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:10.874418 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.874870 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:10.875700 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:10.876126 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:11.068419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:11.076462 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5db385bd-f829-4d62-bcc4-b3cadad9ecbb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.505923 Jan 10 12:48:11.077141 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 53/90] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:10 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:11.194996 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:11.203010 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:11.204551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:11.205665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-982dc7a1-95cb-4bc2-a818-d39880d03ba2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.356667 Jan 10 12:48:11.206284 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 38/91] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:10 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:11.255081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:11.255906 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:11.262217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:11.262761 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:11.263748 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:11.263999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:11.469330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:11.478024 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-41a709c5-f3fd-4d4f-91e8-cfdde5e9486c tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.226855 Jan 10 12:48:11.489013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 54/92] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:11 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:11.851726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:11.852284 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:11.859843 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:11.860277 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:11.861062 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:11.861638 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.050683 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:12.058964 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-37591137-b25f-43af-9188-90a7d3ca30cb tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.211390 Jan 10 12:48:12.059608 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 39/93] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:11 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:12.093801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:12.094408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:12.103858 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:12.104312 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.105095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:12.105524 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.225387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:12.226789 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:12.233712 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:12.234345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.235455 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:12.236049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.267042 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:12.282677 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-56ca1267-f85d-4053-9ee8-8874d4fb625a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.192445 Jan 10 12:48:12.283442 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 55/94] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:12 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:12.361344 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-8acb8065-985f-4858-adf0-aeef4dd28ec3 req-fc01af06-e8c0-403c-999e-24c8a90e0c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e102ed1c-55c4-488a-9729-a99f58666989", "tag": "f0859772-0161-44d0-9616-11e398c35d8b"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:12.363180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:12.363180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:12.370088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-8acb8065-985f-4858-adf0-aeef4dd28ec3 req-fc01af06-e8c0-403c-999e-24c8a90e0c32 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:12.370746 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-8acb8065-985f-4858-adf0-aeef4dd28ec3 req-fc01af06-e8c0-403c-999e-24c8a90e0c32 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.384503 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-8acb8065-985f-4858-adf0-aeef4dd28ec3 req-fc01af06-e8c0-403c-999e-24c8a90e0c32 service nova] Creating event network-changed:f0859772-0161-44d0-9616-11e398c35d8b for instance e102ed1c-55c4-488a-9729-a99f58666989 on hv-cinder-maste Jan 10 12:48:12.392420 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-8acb8065-985f-4858-adf0-aeef4dd28ec3 req-fc01af06-e8c0-403c-999e-24c8a90e0c32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034650 Jan 10 12:48:12.393677 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 56/95] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:12.404439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:12.413753 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:12.416613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:12.418883 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-94cd201b-34d8-476c-afe7-aa47c6bfa900 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.197987 Jan 10 12:48:12.420113 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 40/96] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:12 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:48:12.500839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:12.501542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:12.508336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:12.508801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.509591 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:12.510013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:12.658336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:12.666565 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7eb8d1b6-205a-4438-9ac8-735b6e8610a5 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.174510 Jan 10 12:48:12.667142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 57/97] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:12 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:13.076714 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:13.077355 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:13.084059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.084495 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.085321 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.085679 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.218405 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:13.230115 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ec9a5d65-8406-4d40-a7a8-ebb0909c61fe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.156988 Jan 10 12:48:13.230782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 41/98] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:13 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:13.302034 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:13.302903 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:13.310009 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.311891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.313239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.313773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.439152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:13.440130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:13.447192 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.447696 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.448552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.448972 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.483019 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:13.493321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-55d4527e-4715-4fba-a305-e46554e76267 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.197036 Jan 10 12:48:13.494489 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 58/99] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:13 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:13.584146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-dd995865-efdb-43bf-ae94-3bc0af10f5bb req-165536e8-560a-40dc-a7c0-08df95527f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03af44ba-8887-46a6-8431-a348b4376790", "name": "network-vif-plugged", "status": "completed", "tag": "6c86b883-3cd7-458e-b400-d77a0e4ebea6"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:13.586869 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:13.586869 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:13.601690 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-dd995865-efdb-43bf-ae94-3bc0af10f5bb req-165536e8-560a-40dc-a7c0-08df95527f52 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.602844 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-dd995865-efdb-43bf-ae94-3bc0af10f5bb req-165536e8-560a-40dc-a7c0-08df95527f52 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.604784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:13.617581 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:13.619604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:13.621965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3a2c0c24-0444-4243-b4fb-7fdfc59df37d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.187565 Jan 10 12:48:13.623782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 42/100] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:13 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:48:13.641555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-dd995865-efdb-43bf-ae94-3bc0af10f5bb req-165536e8-560a-40dc-a7c0-08df95527f52 service nova] Creating event network-vif-plugged:6c86b883-3cd7-458e-b400-d77a0e4ebea6 for instance 03af44ba-8887-46a6-8431-a348b4376790 on hv-cinder-maste Jan 10 12:48:13.673024 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-dd995865-efdb-43bf-ae94-3bc0af10f5bb req-165536e8-560a-40dc-a7c0-08df95527f52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088034 Jan 10 12:48:13.674383 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 59/101] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:13.687626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:13.688445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:13.700320 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.701723 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.703796 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:13.705778 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:13.985898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:13.994580 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-66fdb046-71fb-4456-b2e3-2ef560a3818b tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.314235 Jan 10 12:48:13.996483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 43/102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:13 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:14.247672 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:14.248729 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:14.256486 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:14.257018 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:14.258099 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:14.258598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:14.423366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:14.430865 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-18f7e714-e645-45e8-92fa-d3df4c8fab9a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.187582 Jan 10 12:48:14.431610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 60/103] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:14 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:14.511464 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:14.512295 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:14.521505 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:14.522034 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:14.523566 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:14.524981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:14.646624 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:14.648257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:14.655355 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:14.656015 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:14.657005 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:14.657828 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:14.710935 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:14.718518 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7c9761f9-7601-46b9-bacd-d081e3510005 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.212059 Jan 10 12:48:14.719687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 44/104] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:14 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:14.802316 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:14.810660 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:14.812652 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:14.813758 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8e9d85a9-dbfe-42d9-a84e-e33ea4884d41 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.175511 Jan 10 12:48:14.814327 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 61/105] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:14 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:15.012303 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:15.012911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:15.019221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.019706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.020481 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.020913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.152651 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:15.160424 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-360b33e3-e0b2-4ca6-8462-9ffc4d2734f6 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.152190 Jan 10 12:48:15.161090 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 45/106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:15 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:15.448489 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:15.449263 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:15.455879 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.456529 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.457670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.458165 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.636288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:15.647561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2711fd34-34e9-4343-b28d-03c7cddbdc9b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.200814 Jan 10 12:48:15.647561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 62/107] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:15 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:15.735361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:15.735782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:15.741960 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.742412 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.743223 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.743697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.832104 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:15.832695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:15.839566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.840031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.840791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:15.841225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:15.890535 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:15.898161 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b72dc49f-c2b9-4953-b56c-b6c1e1a7c6ea tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.166953 Jan 10 12:48:15.898741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 46/108] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:15 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:15.979234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:15.987947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:15.989452 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:15.990572 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cb6ee855-6c41-4d71-afaf-9b90d7e337a3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.162308 Jan 10 12:48:15.991151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 63/109] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:15 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:48:16.181512 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:16.182389 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:16.192782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:16.193393 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:16.194579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:16.195230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:16.346509 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:16.354347 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-99c4cd12-343d-45dc-894e-614b73232469 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.179008 Jan 10 12:48:16.354925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 47/110] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:16 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:16.665620 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:16.666230 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:16.672504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:16.672947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:16.673730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:16.674161 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:16.820512 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:16.827855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-46a26a2a-9e89-43de-aee1-ec1cb7e715b4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.165893 Jan 10 12:48:16.828435 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 64/111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:16 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:16.916708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:16.917501 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:16.925635 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:16.926080 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:16.926850 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:16.927278 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.008522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:17.009134 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:17.015728 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:17.016186 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.017125 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:17.017845 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.096543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:17.104618 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c82d907f-a443-4080-9a1d-8b7db76c030b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.193105 Jan 10 12:48:17.105384 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 48/112] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:16 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:17.165640 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:17.173465 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:17.175218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:17.176355 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-94fa5a06-92ac-4686-aecd-8dc53f132f0b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.171660 Jan 10 12:48:17.176926 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 65/113] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:17 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:17.371120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:17.371770 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:17.378591 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:17.379046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.379875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:17.380317 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.528887 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:17.537055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b2a617d5-0b1b-46f8-9e76-6cd626796c32 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.169564 Jan 10 12:48:17.538115 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 49/114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:17 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:17.807145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-a6620268-5a2b-4cdc-8cba-4570f23fa4a7 req-6b30edd6-ded8-4cff-a88f-a186458a9b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3436ba09-022f-4b36-987d-667c236d68d1", "name": "network-vif-plugged", "status": "completed", "tag": "0341fd05-df0a-4b20-a713-82457a146a1c"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:17.810042 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:17.810042 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:17.818887 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-a6620268-5a2b-4cdc-8cba-4570f23fa4a7 req-6b30edd6-ded8-4cff-a88f-a186458a9b39 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:17.819667 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-a6620268-5a2b-4cdc-8cba-4570f23fa4a7 req-6b30edd6-ded8-4cff-a88f-a186458a9b39 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.830975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-a6620268-5a2b-4cdc-8cba-4570f23fa4a7 req-6b30edd6-ded8-4cff-a88f-a186458a9b39 service nova] Creating event network-vif-plugged:0341fd05-df0a-4b20-a713-82457a146a1c for instance 3436ba09-022f-4b36-987d-667c236d68d1 on hv-cinder-maste Jan 10 12:48:17.835884 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-a6620268-5a2b-4cdc-8cba-4570f23fa4a7 req-6b30edd6-ded8-4cff-a88f-a186458a9b39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033425 Jan 10 12:48:17.836470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 66/115] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:17.844516 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:17.845131 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:17.851183 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:17.851693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.852473 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:17.852905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:17.993812 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:18.001325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e898d2d4-1bad-4259-adff-e81e9b11776d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.160500 Jan 10 12:48:18.002235 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 50/116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:17 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:18.125435 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:18.126437 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:18.133423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:18.133811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:18.134586 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:18.135021 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:18.194527 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:18.195125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:18.201337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:18.201803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:18.202559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:18.202995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:18.326401 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:18.334802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-045d207a-4b05-4429-b869-927f2a0cdb05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.215850 Jan 10 12:48:18.335543 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 67/117] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:18 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:18.372263 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:18.380373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:18.381890 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:18.383007 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-16e1a91d-4c47-4132-a8ae-f72915841e84 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.192324 Jan 10 12:48:18.383701 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 51/118] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:18 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:18.558142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:18.559146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:18.570228 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:18.570977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:18.572309 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:18.573028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:18.722850 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:18.730259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2c413659-2a58-410b-bf1c-9a124348d293 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.178526 Jan 10 12:48:18.730863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 68/119] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:18 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:19.023410 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:19.024527 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:19.034695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.035147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.035976 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.036419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.176566 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:19.183965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0d151b4f-d4a9-4c29-b77c-1e69e8cd2736 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.167659 Jan 10 12:48:19.184548 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 52/120] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:19 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:19.355708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:19.356675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:19.365118 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.365566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.366373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.366810 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.401276 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:19.401952 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:19.408512 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.409028 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.409846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.410424 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.529536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:19.538102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4f9052fc-71f2-490a-af0a-10751dcae259 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.188496 Jan 10 12:48:19.538778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 69/121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:19 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:19.574224 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:19.582349 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:19.583907 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:19.585021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4a4f25dc-3296-4652-8421-56f98c0d591f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.187787 Jan 10 12:48:19.585598 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 53/122] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:19 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:19.747824 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:19.748430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:19.755416 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.755894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.756671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:19.757094 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:19.893037 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:19.900496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2f8a5328-7b5b-46b9-a2d0-bfe81b0c6315 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.156433 Jan 10 12:48:19.901041 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 70/123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:19 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:20.201319 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:20.201894 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:20.208588 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.209034 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:20.209811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.210243 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:20.352585 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:20.360358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-aa723dae-9db1-4043-b4f9-06b3600238e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.162842 Jan 10 12:48:20.360972 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 54/124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:20 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:20.559147 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:20.560012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:20.570670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.571412 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:20.572782 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.573510 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:20.603298 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:20.603940 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:20.610276 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.610726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:20.611507 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.611952 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:20.761042 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:20.769875 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f6036f10-ae5a-4cc3-a927-dca492416628 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.216617 Jan 10 12:48:20.770602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 71/125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:20 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:20.792196 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:20.802861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:20.804448 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:20.805563 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-78e24778-30c0-44a7-a194-4127c09ba946 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.205997 Jan 10 12:48:20.806139 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 55/126] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:20 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:20.917376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:20.917949 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:20.924222 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.924700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:20.925730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:20.926136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:21.061851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:21.069256 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5df47d19-552d-445e-a468-c5c46abbf091 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.155584 Jan 10 12:48:21.069865 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 72/127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:20 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:21.381811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:21.382733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:21.392994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:21.393735 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:21.395221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:21.395721 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:21.527155 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:21.535414 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-551ccd27-41bd-469d-b38e-a2acd8701efe tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.160585 Jan 10 12:48:21.536046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 56/128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:21 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:21.787844 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:21.788442 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:21.794836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:21.795279 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:21.796082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:21.796510 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:21.823837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:21.824434 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:21.831098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:21.831596 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:21.832398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:21.832824 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:21.963922 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:21.973480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6a3f3cc6-b341-49aa-9e80-a92fbfd69c75 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.190615 Jan 10 12:48:21.974069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 73/129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:21 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:22.014565 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:22.020996 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:22.022517 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:22.023666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-eab333ed-6fb5-4d04-b2ca-d72ad047cb80 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.203566 Jan 10 12:48:22.024303 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 57/130] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:21 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:22.089274 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:22.090267 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:22.100454 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:22.101206 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:22.102478 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:22.103175 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:22.239062 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:22.247211 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-781cf45b-b4b4-43d1-b89e-3b1b10f3ddce tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.164000 Jan 10 12:48:22.247755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 74/131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:22 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:22.556967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:22.557888 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:22.568022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:22.568470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:22.569241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:22.569666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:22.706814 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:22.715902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-14536c8d-6a0d-442b-b77f-2eff02e6bb56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.165695 Jan 10 12:48:22.716802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 58/132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:22 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:22.992108 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:22.992797 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:23.000360 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.000889 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.001797 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.002300 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.045626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:23.046225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:23.058762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.059388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.060318 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.061367 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.191803 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:23.199807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c772f335-c3dd-488d-9d82-99f73f1cf082 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.212866 Jan 10 12:48:23.200391 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 75/133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:22 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:23.234915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:23.244273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:23.245783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:23.246900 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3d0d9df4-4dc7-4172-ac16-22e16e943489 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.205321 Jan 10 12:48:23.247488 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 59/134] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:23 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:23.264498 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:23.265105 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:23.271898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.272343 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.273120 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.273551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.410915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:23.418973 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-290f2ed7-117c-4396-95e8-7a8b0084a702 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1315 microversion: 2.1 time: 0.158248 Jan 10 12:48:23.419567 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 76/135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:23 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:23.735359 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:23.739120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:23.746479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.747018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.747949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:23.748468 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:23.895204 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:23.903316 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5dee995c-2f4f-40a0-9594-b7be21a7e0a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1318 microversion: 2.1 time: 0.173367 Jan 10 12:48:23.903871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 60/136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:23 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:24.216800 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:24.217955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:24.235950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.236418 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.237186 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.238876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.268168 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:24.268771 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:24.275275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.275765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.276552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.277031 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.616723 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:24.623846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:24.625901 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-835d527a-5155-4189-98f7-d87468f6ccf1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.413173 Jan 10 12:48:24.626999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 77/137] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:24 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:24.632027 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:24.632982 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:24.639555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.639727 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:24.640487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.641091 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:24.641808 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.642319 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.642451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-edff88f5-4b34-415b-bbc8-0d97ecdb02b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1405 microversion: 2.20 time: 0.380883 Jan 10 12:48:24.643243 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 61/138] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:24 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:48:24.742603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-0c7b4ea6-067b-4f77-9f43-8307cbc717f2 req-a7335684-2038-4aeb-8ed3-2f8371df1d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d250b-ae30-4ddc-9e68-0272505cf636", "name": "network-vif-plugged", "status": "completed", "tag": "5f9bf9f4-13cb-4777-adde-d6b21836bdff"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:24.744933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:24.744933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:48:24.760506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0c7b4ea6-067b-4f77-9f43-8307cbc717f2 req-a7335684-2038-4aeb-8ed3-2f8371df1d43 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.761013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0c7b4ea6-067b-4f77-9f43-8307cbc717f2 req-a7335684-2038-4aeb-8ed3-2f8371df1d43 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.775307 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-0c7b4ea6-067b-4f77-9f43-8307cbc717f2 req-a7335684-2038-4aeb-8ed3-2f8371df1d43 service nova] Creating event network-vif-plugged:5f9bf9f4-13cb-4777-adde-d6b21836bdff for instance 7c7d250b-ae30-4ddc-9e68-0272505cf636 on hv-cinder-maste Jan 10 12:48:24.781792 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-0c7b4ea6-067b-4f77-9f43-8307cbc717f2 req-a7335684-2038-4aeb-8ed3-2f8371df1d43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044042 Jan 10 12:48:24.783912 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 62/139] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:24.815961 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:24.826416 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-947ab64b-1796-4a22-ac72-e58d250c04de tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1501 microversion: 2.1 time: 0.197988 Jan 10 12:48:24.827318 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 78/140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:24 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:24.922781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:24.923709 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:24.931422 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.932524 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:24.933731 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:24.934379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:25.092934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:25.102227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8a5480b1-a6fd-4b38-8569-08d9c39ba6bf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1508 microversion: 2.1 time: 0.184874 Jan 10 12:48:25.102811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 63/141] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:24 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:25.643760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:25.644819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:25.651618 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:25.652255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:25.653063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:25.653724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:25.661776 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:25.662641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:25.671494 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:25.672186 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:25.672997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:25.673631 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:25.937866 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:25.951659 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-adfb51b9-e3b0-4312-97de-ba48e8ada712 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1320 microversion: 2.1 time: 0.311669 Jan 10 12:48:25.954013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:25.955671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 79/142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:25 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:25.962428 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:25.963959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:25.965519 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b3222db4-cce2-4a95-9d3a-82845d2621b8 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1597 microversion: 2.20 time: 0.308759 Jan 10 12:48:25.966270 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 64/143] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:48:25 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1597 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:48:25.985218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-89b05499-1619-4c7b-9b39-166d9b9f5353 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:25.986745 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-89b05499-1619-4c7b-9b39-166d9b9f5353 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:25.993787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-89b05499-1619-4c7b-9b39-166d9b9f5353 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:25.994516 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-89b05499-1619-4c7b-9b39-166d9b9f5353 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:25.995484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-89b05499-1619-4c7b-9b39-166d9b9f5353 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:25.996367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-89b05499-1619-4c7b-9b39-166d9b9f5353 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:26.124528 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-89b05499-1619-4c7b-9b39-166d9b9f5353 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.142958 Jan 10 12:48:26.125142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 80/144] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jan 10 12:48:25 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:48:26.276958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-06c3ef02-b034-477f-8a81-09a4bb2ec126 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "398cca05-38a8-43ad-bc5b-708ae7c5da40"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:26.278418 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-06c3ef02-b034-477f-8a81-09a4bb2ec126 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:26.284648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06c3ef02-b034-477f-8a81-09a4bb2ec126 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:26.285207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06c3ef02-b034-477f-8a81-09a4bb2ec126 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:26.286458 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06c3ef02-b034-477f-8a81-09a4bb2ec126 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:26.286959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06c3ef02-b034-477f-8a81-09a4bb2ec126 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:26.487402 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d9bb463b-1523-4955-b5fb-a4b3bdb16448 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ff3d553-66f5-4833-ad6e-8f8440b38a4e"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:26.488651 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d9bb463b-1523-4955-b5fb-a4b3bdb16448 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:26.494588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d9bb463b-1523-4955-b5fb-a4b3bdb16448 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:26.495029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d9bb463b-1523-4955-b5fb-a4b3bdb16448 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:26.495894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d9bb463b-1523-4955-b5fb-a4b3bdb16448 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:26.496618 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d9bb463b-1523-4955-b5fb-a4b3bdb16448 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:26.683146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-06c3ef02-b034-477f-8a81-09a4bb2ec126 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "POST /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409787 Jan 10 12:48:26.689909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 65/145] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:48:26 2022] POST /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:26.847208 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-abfce4b9-05b5-403d-aa19-9371c0ffa326 req-c61e03bd-b3ee-4994-a3ee-d61beb5a5f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e102ed1c-55c4-488a-9729-a99f58666989", "name": "network-vif-plugged", "status": "completed", "tag": "f0859772-0161-44d0-9616-11e398c35d8b"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:26.849189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:26.849189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:48:26.874467 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-abfce4b9-05b5-403d-aa19-9371c0ffa326 req-c61e03bd-b3ee-4994-a3ee-d61beb5a5f45 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:26.876076 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-abfce4b9-05b5-403d-aa19-9371c0ffa326 req-c61e03bd-b3ee-4994-a3ee-d61beb5a5f45 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:26.892750 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d9bb463b-1523-4955-b5fb-a4b3bdb16448 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409000 Jan 10 12:48:26.896356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 81/146] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:48:26 2022] POST /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:26.897227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-abfce4b9-05b5-403d-aa19-9371c0ffa326 req-c61e03bd-b3ee-4994-a3ee-d61beb5a5f45 service nova] Creating event network-vif-plugged:f0859772-0161-44d0-9616-11e398c35d8b for instance e102ed1c-55c4-488a-9729-a99f58666989 on hv-cinder-maste Jan 10 12:48:26.912171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-abfce4b9-05b5-403d-aa19-9371c0ffa326 req-c61e03bd-b3ee-4994-a3ee-d61beb5a5f45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069343 Jan 10 12:48:26.913797 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 66/147] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:26.973605 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:26.974642 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:26.986554 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:26.987013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:26.987907 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:26.989867 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:27.466830 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:27.474931 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c0db7de5-8bac-43cb-aff5-330da6c68227 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1513 microversion: 2.1 time: 0.505902 Jan 10 12:48:27.485602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 82/148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:26 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:27.492683 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:27.493672 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:27.500421 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:27.500891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:27.501688 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:27.502140 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:27.525791 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lazy-loading 'flavor' on Instance uuid 7c7d250b-ae30-4ddc-9e68-0272505cf636 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:48:27.662216 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a52d320a-cbde-45ee-acac-7d54eee105af tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636/action" status: 200 len: 32 microversion: 2.1 time: 0.173983 Jan 10 12:48:27.668550 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 67/149] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:48:27 2022] POST /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:48:27.674255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:27.674925 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:27.681279 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:27.681737 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:27.682526 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:27.682963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:27.857419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3aa3dec6-fceb-4300-a407-f5a25539e117 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:27.858754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3aa3dec6-fceb-4300-a407-f5a25539e117 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:27.865780 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3aa3dec6-fceb-4300-a407-f5a25539e117 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:27.866501 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3aa3dec6-fceb-4300-a407-f5a25539e117 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:27.867529 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3aa3dec6-fceb-4300-a407-f5a25539e117 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:27.868173 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3aa3dec6-fceb-4300-a407-f5a25539e117 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:27.946646 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:27.954942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-31143b9b-eff7-4d97-ae18-fa70c236293a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.284406 Jan 10 12:48:27.956045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 83/150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:27 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:28.137122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-dd1d5002-6f67-48ff-92b6-c46bb8594cc1 req-9f289ed0-7303-473c-b6ed-403dc751604f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3436ba09-022f-4b36-987d-667c236d68d1", "tag": "0341fd05-df0a-4b20-a713-82457a146a1c"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:28.138699 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:28.138699 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:28.146650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-dd1d5002-6f67-48ff-92b6-c46bb8594cc1 req-9f289ed0-7303-473c-b6ed-403dc751604f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:28.147088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-dd1d5002-6f67-48ff-92b6-c46bb8594cc1 req-9f289ed0-7303-473c-b6ed-403dc751604f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:28.158180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-dd1d5002-6f67-48ff-92b6-c46bb8594cc1 req-9f289ed0-7303-473c-b6ed-403dc751604f service nova] Creating event network-changed:0341fd05-df0a-4b20-a713-82457a146a1c for instance 3436ba09-022f-4b36-987d-667c236d68d1 on hv-cinder-maste Jan 10 12:48:28.163827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-dd1d5002-6f67-48ff-92b6-c46bb8594cc1 req-9f289ed0-7303-473c-b6ed-403dc751604f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116595 Jan 10 12:48:28.164983 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 84/151] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:28.973505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:28.974198 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:28.980829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:28.981283 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:28.982081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:28.982518 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:29.137387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:29.145890 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-833bad98-23bd-4bd0-a6ba-732eecf1cc83 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.176750 Jan 10 12:48:29.155487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 85/152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:28 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:30.163136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:30.163807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:30.170239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:30.171038 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:30.172020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:30.172506 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:30.307485 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:30.317459 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e027edc9-fea0-4805-94d3-e09ae7236738 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.159017 Jan 10 12:48:30.318245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 86/153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:30 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:30.444167 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3aa3dec6-fceb-4300-a407-f5a25539e117 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 2.590608 Jan 10 12:48:30.447917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 68/154] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:27 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:31.334417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:31.335615 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:31.342533 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:31.343230 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:31.344239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:31.345652 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:31.455633 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-09426fef-7182-4928-8a19-e65e0ea9fa53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:31.456837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-09426fef-7182-4928-8a19-e65e0ea9fa53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:31.466119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-09426fef-7182-4928-8a19-e65e0ea9fa53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:31.466735 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-09426fef-7182-4928-8a19-e65e0ea9fa53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:31.467697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-09426fef-7182-4928-8a19-e65e0ea9fa53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:31.468236 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-09426fef-7182-4928-8a19-e65e0ea9fa53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:31.511170 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:31.519137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-80fd57c3-eb9f-4c9c-93cd-c8c3150da1a8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.188773 Jan 10 12:48:31.519938 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 87/155] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:31 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:31.546927 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-09426fef-7182-4928-8a19-e65e0ea9fa53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.095596 Jan 10 12:48:31.550722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 69/156] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:31 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:32.536460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:32.537074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:32.544009 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:32.544457 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:32.545243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:32.545674 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:32.558594 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-be58818e-bab1-479a-91dc-c3b481a7d760 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:32.559632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-be58818e-bab1-479a-91dc-c3b481a7d760 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:32.567590 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-be58818e-bab1-479a-91dc-c3b481a7d760 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:32.567783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-be58818e-bab1-479a-91dc-c3b481a7d760 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:32.568443 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-be58818e-bab1-479a-91dc-c3b481a7d760 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:32.568878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-be58818e-bab1-479a-91dc-c3b481a7d760 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:32.643223 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-be58818e-bab1-479a-91dc-c3b481a7d760 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.088341 Jan 10 12:48:32.646466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 70/157] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:32 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:32.734446 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:32.744843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d18d9745-ca42-4480-a50c-080100d1a489 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.212197 Jan 10 12:48:32.752006 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 88/158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:32 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:33.657405 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a3e8068f-ae58-4208-a0f7-c36afb4c6d59 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:33.658324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a3e8068f-ae58-4208-a0f7-c36afb4c6d59 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:33.665844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a3e8068f-ae58-4208-a0f7-c36afb4c6d59 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:33.666279 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a3e8068f-ae58-4208-a0f7-c36afb4c6d59 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:33.667087 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a3e8068f-ae58-4208-a0f7-c36afb4c6d59 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:33.668158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a3e8068f-ae58-4208-a0f7-c36afb4c6d59 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:33.742700 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a3e8068f-ae58-4208-a0f7-c36afb4c6d59 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.089437 Jan 10 12:48:33.743380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 71/159] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:33 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:33.761504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:33.762407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:33.770487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:33.770952 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:33.771753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:33.772201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:33.918789 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:33.927644 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e6688bf2-1e8e-4477-bac3-147c3ad9844c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.168712 Jan 10 12:48:33.927644 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 89/160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:33 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:34.760827 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-00bde792-c07e-4cd1-8498-c6dd77e388df tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:34.760827 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-00bde792-c07e-4cd1-8498-c6dd77e388df tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:34.764039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00bde792-c07e-4cd1-8498-c6dd77e388df tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:34.764471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00bde792-c07e-4cd1-8498-c6dd77e388df tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:34.765345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00bde792-c07e-4cd1-8498-c6dd77e388df tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:34.766698 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00bde792-c07e-4cd1-8498-c6dd77e388df tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:34.946310 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:34.946956 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:34.954394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:34.955251 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:34.956340 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:34.956865 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:35.035746 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-00bde792-c07e-4cd1-8498-c6dd77e388df tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.285026 Jan 10 12:48:35.037221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 72/161] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:34 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:35.148154 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:35.158537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c489c858-a542-41c1-b122-5479125bc35f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.215744 Jan 10 12:48:35.161860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 90/162] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:34 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:36.047184 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7040402b-d4df-46ad-ab79-650f6ab1555e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:36.049482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7040402b-d4df-46ad-ab79-650f6ab1555e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:36.060375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7040402b-d4df-46ad-ab79-650f6ab1555e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:36.061199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7040402b-d4df-46ad-ab79-650f6ab1555e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:36.063128 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7040402b-d4df-46ad-ab79-650f6ab1555e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:36.063715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7040402b-d4df-46ad-ab79-650f6ab1555e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:36.138699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7040402b-d4df-46ad-ab79-650f6ab1555e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.095718 Jan 10 12:48:36.139323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 73/163] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:36 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:36.177975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:36.178594 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:36.186678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:36.187193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:36.188266 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:36.188922 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:36.372689 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:36.381962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-060f6290-527d-477a-b324-357df358f260 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.207746 Jan 10 12:48:36.384391 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 91/164] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:36 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:37.151334 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cc9e949d-250f-476a-b2c0-223333125068 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:37.154663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cc9e949d-250f-476a-b2c0-223333125068 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:37.163725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc9e949d-250f-476a-b2c0-223333125068 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:37.164571 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc9e949d-250f-476a-b2c0-223333125068 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:37.165600 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc9e949d-250f-476a-b2c0-223333125068 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:37.166260 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc9e949d-250f-476a-b2c0-223333125068 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:37.242223 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cc9e949d-250f-476a-b2c0-223333125068 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.095481 Jan 10 12:48:37.242937 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 74/165] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:37 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:37.401540 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:37.403462 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:37.413375 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:37.414048 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:37.415802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:37.416840 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:37.568017 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:37.576275 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a41669a3-2beb-48de-8ee7-86cb19f390f8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.180616 Jan 10 12:48:37.576951 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 92/166] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:37 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:38.253949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1a600717-86f0-4394-856c-d934cf625a20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:38.255836 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1a600717-86f0-4394-856c-d934cf625a20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:38.264241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a600717-86f0-4394-856c-d934cf625a20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:38.264774 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a600717-86f0-4394-856c-d934cf625a20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:38.272021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a600717-86f0-4394-856c-d934cf625a20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:38.272475 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a600717-86f0-4394-856c-d934cf625a20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:38.358502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1a600717-86f0-4394-856c-d934cf625a20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.108449 Jan 10 12:48:38.359147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 75/167] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:38 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:38.597889 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:38.599058 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:38.606222 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:38.607102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:38.608157 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:38.608839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:38.836624 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:38.846029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-697b557d-d356-473a-a6be-8b3589f113b7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.256104 Jan 10 12:48:38.846743 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 93/168] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:38 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:39.371957 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8c0af21c-34ae-42e4-b4e7-c32fe76df9a5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:39.372877 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8c0af21c-34ae-42e4-b4e7-c32fe76df9a5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:39.381046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c0af21c-34ae-42e4-b4e7-c32fe76df9a5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:39.382112 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c0af21c-34ae-42e4-b4e7-c32fe76df9a5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:39.383099 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c0af21c-34ae-42e4-b4e7-c32fe76df9a5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:39.383784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c0af21c-34ae-42e4-b4e7-c32fe76df9a5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:39.467749 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8c0af21c-34ae-42e4-b4e7-c32fe76df9a5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.099774 Jan 10 12:48:39.471164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 76/169] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:39 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:39.637495 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1011287728", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "d9e7fcc6-2783-48be-a124-60b02ce632b7"}]}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:39.721899 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] validate_networks() for [('d9e7fcc6-2783-48be-a124-60b02ce632b7', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:48:39.788453 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:39.789391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:39.806856 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:39.811063 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:39.813614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:39.818854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:39.888662 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Going to try to terminate instance {{(pid=123137) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:48:39.999426 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f8839dcd-4e0a-4abc-9d25-0971831647b0 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 204 len: 0 microversion: 2.1 time: 0.214442 Jan 10 12:48:40.000257 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 77/170] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:48:39 2022] DELETE /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:48:40.005855 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:40.006554 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:40.012924 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.013397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.014459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.014845 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.208692 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:48:40.209234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:48:40.209779 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:48:40.210362 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:48:40.211014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:48:40.220194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.220754 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.221638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.222118 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.236266 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:40.240183 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Getting quotas for project 9c74d48e1e934088addee3d78ddbe485. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:48:40.245014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Getting quotas for user 154d8ba69dce42fe85ae3a0ad7602bb2 and project 9c74d48e1e934088addee3d78ddbe485. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:48:40.245965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b24a23d6-314b-4246-a8c8-0cd9e0f3b4ff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.244190 Jan 10 12:48:40.246582 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 78/171] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:40 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:40.259075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:48:40.259866 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:40.260691 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:40.261864 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:48:40.267409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.267931 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.268774 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.269241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.321520 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6465de09-2718-42b3-81ef-343ba183a96e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687244 Jan 10 12:48:40.322735 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 94/172] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:48:40.337731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d74631b6-bf60-4fbf-a3fb-a6f2287b556e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:40.338401 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d74631b6-bf60-4fbf-a3fb-a6f2287b556e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:40.415733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d74631b6-bf60-4fbf-a3fb-a6f2287b556e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:40.425466 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d74631b6-bf60-4fbf-a3fb-a6f2287b556e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1214 microversion: 2.1 time: 0.092187 Jan 10 12:48:40.426335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 95/173] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:40 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:40.449462 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:40.458478 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0c983941-1ca4-4746-a5bb-07c10f291c55 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1553 microversion: 2.1 time: 0.210666 Jan 10 12:48:40.459362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 79/174] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:40 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:40.478794 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1378f35d-c680-4fd6-82db-f1aafc5958af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:40.480518 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1378f35d-c680-4fd6-82db-f1aafc5958af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:40.486939 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1378f35d-c680-4fd6-82db-f1aafc5958af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.487400 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1378f35d-c680-4fd6-82db-f1aafc5958af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.488397 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1378f35d-c680-4fd6-82db-f1aafc5958af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:40.488988 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1378f35d-c680-4fd6-82db-f1aafc5958af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:40.569307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1378f35d-c680-4fd6-82db-f1aafc5958af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 14 microversion: 2.20 time: 0.094372 Jan 10 12:48:40.570092 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 96/175] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:40 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:41.262392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:41.263021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:41.271338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.271853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.272757 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.273225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.446110 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:41.448687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:41.461583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.462949 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.465222 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.466519 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.699825 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:41.711151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7caaf617-9c7c-470e-9e99-bac9732887dc tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1274 microversion: 2.1 time: 0.271071 Jan 10 12:48:41.712158 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 97/176] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:41 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:41.723665 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:41.724784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:41.759300 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.759768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.760561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.760991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.783551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:41.792636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6766057e-ca3c-43c9-88e2-6d9bc78e0b98 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.533883 Jan 10 12:48:41.795064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 80/177] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:41 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:41.803470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ea16452b-d66e-4a12-9c2c-8734fe9be446 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:41.806202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ea16452b-d66e-4a12-9c2c-8734fe9be446 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:41.813546 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea16452b-d66e-4a12-9c2c-8734fe9be446 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.814346 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea16452b-d66e-4a12-9c2c-8734fe9be446 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.815486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea16452b-d66e-4a12-9c2c-8734fe9be446 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:41.816167 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea16452b-d66e-4a12-9c2c-8734fe9be446 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:41.926528 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ea16452b-d66e-4a12-9c2c-8734fe9be446 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 6520 microversion: 2.20 time: 0.127043 Jan 10 12:48:41.928088 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 81/178] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:41 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 6520 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:48:41.940277 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:41.948454 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f8c9272d-5132-425e-ba31-8daf8f49f104 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1553 microversion: 2.1 time: 0.234257 Jan 10 12:48:41.958914 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 98/179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:41 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:42.728615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:42.729320 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:42.736797 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:42.737247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:42.738119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:42.739100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:42.812673 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:42.813384 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:42.821886 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:42.822357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:42.823160 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:42.823628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:42.906608 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:42.918980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6fff6c29-1e54-4968-b613-6820e01c707f tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.194498 Jan 10 12:48:42.920001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 82/180] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:42 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:42.939853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-07799adc-52a5-4eed-bbb8-3310c41399ab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:42.940871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-07799adc-52a5-4eed-bbb8-3310c41399ab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:42.948154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07799adc-52a5-4eed-bbb8-3310c41399ab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:42.948610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07799adc-52a5-4eed-bbb8-3310c41399ab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:42.949710 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07799adc-52a5-4eed-bbb8-3310c41399ab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:42.950323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07799adc-52a5-4eed-bbb8-3310c41399ab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:43.036160 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-07799adc-52a5-4eed-bbb8-3310c41399ab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 11535 microversion: 2.20 time: 0.101335 Jan 10 12:48:43.037079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 83/181] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:42 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 11535 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:48:43.044899 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:43.045871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:43.052980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:43.053431 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:43.054263 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:43.054699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:43.132081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:43.140531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b294feec-b2dc-4266-a724-23edecf0bd7b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.331981 Jan 10 12:48:43.141120 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 99/182] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:42 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:43.209351 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:43.218324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-65e296ba-013f-42e6-994c-68d92e3ecd0e tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1553 microversion: 2.1 time: 0.179511 Jan 10 12:48:43.218903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 84/183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:43 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:43.640533 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-f8553046-2184-4a69-9736-563f4aa0f0f0 req-179c918f-6470-4dac-a360-b35425b0254e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5293f2-dd8c-49b7-b758-6a921c8addd7", "name": "network-vif-deleted", "tag": "20b9c325-c5a2-4308-bf9c-add26af27b1a"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:43.642259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:43.642259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:43.653558 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-f8553046-2184-4a69-9736-563f4aa0f0f0 req-179c918f-6470-4dac-a360-b35425b0254e service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:43.653759 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-f8553046-2184-4a69-9736-563f4aa0f0f0 req-179c918f-6470-4dac-a360-b35425b0254e service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:43.682903 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-f8553046-2184-4a69-9736-563f4aa0f0f0 req-179c918f-6470-4dac-a360-b35425b0254e service nova] Creating event network-vif-deleted:20b9c325-c5a2-4308-bf9c-add26af27b1a for instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 on hv-cinder-maste Jan 10 12:48:43.703906 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-f8553046-2184-4a69-9736-563f4aa0f0f0 req-179c918f-6470-4dac-a360-b35425b0254e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070547 Jan 10 12:48:43.712282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 100/184] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:43.937116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:43.937793 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:43.944876 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:43.945388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:43.946253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:43.946754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.050852 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0ba0f8d0-55e3-40df-9c4e-db61b3fb286e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:44.054787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0ba0f8d0-55e3-40df-9c4e-db61b3fb286e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:44.091905 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ba0f8d0-55e3-40df-9c4e-db61b3fb286e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:44.092474 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ba0f8d0-55e3-40df-9c4e-db61b3fb286e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.095337 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ba0f8d0-55e3-40df-9c4e-db61b3fb286e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:44.095816 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ba0f8d0-55e3-40df-9c4e-db61b3fb286e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.207929 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0ba0f8d0-55e3-40df-9c4e-db61b3fb286e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 16403 microversion: 2.20 time: 0.163400 Jan 10 12:48:44.209126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 101/185] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:44 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 16403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:48:44.214778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:44.216417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:44.234425 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:44.235085 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.236105 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:44.239134 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.239292 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:44.247929 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-915250ce-f408-4f14-8568-a5491a10a957 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.315231 Jan 10 12:48:44.248519 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 85/186] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:43 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:44.256863 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:44.265701 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:44.275022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:44.275708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.276775 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:44.277438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.346367 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:44.346834 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:44.347383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lazy-loading 'fault' on Instance uuid 5f5293f2-dd8c-49b7-b758-6a921c8addd7 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:48:44.423988 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5883f052c7b64d74b361cd1c8f689061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30d54bc5b800487db219940267292ed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:44.433473 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3228d32c-8862-4588-b406-855256f38e84 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 200 len: 1351 microversion: 2.1 time: 0.183050 Jan 10 12:48:44.433951 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 86/187] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:44 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 1351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:44.518202 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:44.528739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d35cfebf-a116-4c8c-a1cc-1d0fd45fd689 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.318022 Jan 10 12:48:44.530193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 102/188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:44 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:45.223118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-538970a6-9843-4881-9827-20baa7d96462 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:45.225604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-538970a6-9843-4881-9827-20baa7d96462 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:45.241803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-538970a6-9843-4881-9827-20baa7d96462 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.242246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-538970a6-9843-4881-9827-20baa7d96462 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.243446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-538970a6-9843-4881-9827-20baa7d96462 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.245536 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-538970a6-9843-4881-9827-20baa7d96462 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.265163 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:45.265949 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:45.278373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.280336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.281142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.281581 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.353291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-538970a6-9843-4881-9827-20baa7d96462 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 17602 microversion: 2.20 time: 0.136914 Jan 10 12:48:45.354079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 87/189] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:45 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 17602 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:45.438518 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:45.448848 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-97ce2ce0-d21a-4cad-b8d9-f706a577f300 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.187383 Jan 10 12:48:45.449972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 103/190] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:45 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:45.451066 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:45.451932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:45.459068 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.461388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.462215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.462664 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.478488 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] HTTP exception thrown: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. Jan 10 12:48:45.479177 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Returning 404 to user: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:48:45.480148 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fd27829a-cc67-480e-8879-847786647999 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 404 len: 111 microversion: 2.1 time: 0.033606 Jan 10 12:48:45.481056 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 88/191] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:45 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 12:48:45.547792 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:45.548798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:45.559786 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.560922 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.562002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.563134 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.596242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:45.597309 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:45.622812 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.624393 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.626994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.628451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.651012 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] HTTP exception thrown: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. Jan 10 12:48:45.651663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Returning 404 to user: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:48:45.652484 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fa702366-266a-4a61-ad25-f2a7ef0a89e9 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061784 Jan 10 12:48:45.653049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 89/192] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:48:45 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:48:45.736675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-8fff8efb-b886-4a53-8bfe-05ca0462271a req-35fd915c-55b5-4aba-bc6a-cf603ce2971d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27536579-386a-4119-81b7-0c48316a5fe1", "tag": "b9048143-da43-4ebf-95fd-5fad4bfb2326"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:45.743555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:45.743555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:48:45.746531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-8fff8efb-b886-4a53-8bfe-05ca0462271a req-35fd915c-55b5-4aba-bc6a-cf603ce2971d service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:45.746973 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-8fff8efb-b886-4a53-8bfe-05ca0462271a req-35fd915c-55b5-4aba-bc6a-cf603ce2971d service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:45.766672 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-8fff8efb-b886-4a53-8bfe-05ca0462271a req-35fd915c-55b5-4aba-bc6a-cf603ce2971d service nova] Creating event network-changed:b9048143-da43-4ebf-95fd-5fad4bfb2326 for instance 27536579-386a-4119-81b7-0c48316a5fe1 on hv-cinder-maste Jan 10 12:48:45.772358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-8fff8efb-b886-4a53-8bfe-05ca0462271a req-35fd915c-55b5-4aba-bc6a-cf603ce2971d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051578 Jan 10 12:48:45.773141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 90/193] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:45.854816 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:45.870141 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c43c9c94-3bdd-414b-9ce5-89c0cd5ed43f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.322469 Jan 10 12:48:45.871152 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 104/194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:45 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:46.377053 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1a7145b2-953b-4038-aa58-d40bb35ae294 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:46.378499 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1a7145b2-953b-4038-aa58-d40bb35ae294 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:46.392147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a7145b2-953b-4038-aa58-d40bb35ae294 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:46.393944 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a7145b2-953b-4038-aa58-d40bb35ae294 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:46.399633 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a7145b2-953b-4038-aa58-d40bb35ae294 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:46.400307 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1a7145b2-953b-4038-aa58-d40bb35ae294 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:46.466351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:46.467017 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:46.475145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:46.475860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:46.476678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:46.477104 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:46.493079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1a7145b2-953b-4038-aa58-d40bb35ae294 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 18564 microversion: 2.20 time: 0.123810 Jan 10 12:48:46.493742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 91/195] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:46 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 18564 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:46.508098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1063271346", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "0493530f-49b3-4527-b75d-6de75567c16c"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:46.576821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] validate_networks() for [('0493530f-49b3-4527-b75d-6de75567c16c', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:48:46.695039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:46.705263 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0e08be9e-09c9-4ff8-91e1-b1c704044510 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.241788 Jan 10 12:48:46.706990 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 105/196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:46 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:46.887450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:46.889943 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:46.897928 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:46.898871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:46.899942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:46.900597 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.096109 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:48:47.096978 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:48:47.097504 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:48:47.098439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:48:47.098439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:48:47.107362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.108117 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.109138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.109893 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.130151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:48:47.135337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for user 0513eaec53d241f398508dec85f017d7 and project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:48:47.140966 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:47.147735 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:48:47.150302 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:48:47.151208 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9406d7bf-4fb2-457b-b857-cb8bb1f22d59 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.266832 Jan 10 12:48:47.152535 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 106/197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:46 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:47.158673 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:47.159502 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:47.167259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.167980 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.168888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.169580 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.202056 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] HTTP exception thrown: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. Jan 10 12:48:47.207591 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Returning 404 to user: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:48:47.212432 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6e25e083-196b-4f70-b566-8f4d57715f49 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 404 len: 111 microversion: 2.1 time: 0.056816 Jan 10 12:48:47.213866 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 107/198] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:48:47 2022] DELETE /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:48:47.222857 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7a7a3471-9b34-4b7f-9495-03b547b837b3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727601 Jan 10 12:48:47.223804 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 92/199] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:48:47.234932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-430e22f4-ac15-443e-89f9-1d5d814da0ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:47.235636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-430e22f4-ac15-443e-89f9-1d5d814da0ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:47.243897 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:47.244528 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] [instance: 5f5293f2-dd8c-49b7-b758-6a921c8addd7] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:47.256947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.257297 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.258079 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.258505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.279244 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] HTTP exception thrown: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. Jan 10 12:48:47.280088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] Returning 404 to user: Instance 5f5293f2-dd8c-49b7-b758-6a921c8addd7 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:48:47.281112 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-10229454-61a4-4787-86cf-cc103be78a51 tempest-DeleteServersTestJSON-465668751 tempest-DeleteServersTestJSON-465668751-project] 10.222.0.13 "GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7" status: 404 len: 111 microversion: 2.1 time: 0.062567 Jan 10 12:48:47.282114 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 108/200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:47 2022] GET /compute/v2.1/servers/5f5293f2-dd8c-49b7-b758-6a921c8addd7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:48:47.306802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-430e22f4-ac15-443e-89f9-1d5d814da0ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:47.314865 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-430e22f4-ac15-443e-89f9-1d5d814da0ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1218 microversion: 2.1 time: 0.083934 Jan 10 12:48:47.315472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 93/201] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:47 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:47.506414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0560e840-cf98-4162-80b6-55b0ac0b4811 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:47.509034 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0560e840-cf98-4162-80b6-55b0ac0b4811 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:47.517686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0560e840-cf98-4162-80b6-55b0ac0b4811 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.518374 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0560e840-cf98-4162-80b6-55b0ac0b4811 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.519684 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0560e840-cf98-4162-80b6-55b0ac0b4811 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.520409 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0560e840-cf98-4162-80b6-55b0ac0b4811 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.635595 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0560e840-cf98-4162-80b6-55b0ac0b4811 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 20991 microversion: 2.20 time: 0.133921 Jan 10 12:48:47.636252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 109/202] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:47 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 20991 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:47.723877 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:47.724665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:47.740959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.741425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.742247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:47.742692 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:47.976910 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:47.990694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cfee32b4-4ef8-4cfd-a1ab-5d42cb71fdf4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.268998 Jan 10 12:48:47.991411 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 94/203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:47 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:48.170472 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:48.171233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:48.181201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:48.181698 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:48.182969 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:48.183480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:48.334781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:48.335687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:48.342044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:48.342854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:48.343925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:48.344573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:48.373898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:48.382357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9285749b-05e4-4668-b204-ec968416cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.217147 Jan 10 12:48:48.391966 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 110/204] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:48 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:48.409115 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:48.417391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ca6f0c6c-71dd-4ecd-8718-ed522f64822c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1270 microversion: 2.1 time: 0.086382 Jan 10 12:48:48.417988 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 95/205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:48 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:48.648217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-362268e4-1fe8-4e06-964e-ec8bd783383a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:48.649827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-362268e4-1fe8-4e06-964e-ec8bd783383a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:48.661583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362268e4-1fe8-4e06-964e-ec8bd783383a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:48.662641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362268e4-1fe8-4e06-964e-ec8bd783383a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:48.669517 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362268e4-1fe8-4e06-964e-ec8bd783383a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:48.676474 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362268e4-1fe8-4e06-964e-ec8bd783383a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:48.794051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-362268e4-1fe8-4e06-964e-ec8bd783383a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 22162 microversion: 2.20 time: 0.150255 Jan 10 12:48:48.794768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 111/206] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:48 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 22162 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:49.010366 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:49.011076 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:49.021755 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.022223 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.023645 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.024093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.188035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:49.197173 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f0f18619-52eb-43f7-be97-567c76faaff3 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.192883 Jan 10 12:48:49.198202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 96/207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:49 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:49.400327 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:49.402504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:49.418715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.419441 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.431683 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.432648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.434252 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:49.434921 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:49.447585 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.448045 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.453093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.453601 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.548284 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:49.559795 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c9dd6a46-47cd-4daa-9f56-ae06bc606cd2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1276 microversion: 2.1 time: 0.128191 Jan 10 12:48:49.561333 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 97/208] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:49 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:49.752402 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:49.763637 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5c65a325-1e64-4aa6-99ca-1c5e12879fcf tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.366487 Jan 10 12:48:49.767069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 112/209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:49 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:49.808841 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bc2044cd-881c-462b-97b7-c1461aeff8e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:49.811336 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bc2044cd-881c-462b-97b7-c1461aeff8e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:49.834832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc2044cd-881c-462b-97b7-c1461aeff8e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.847418 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc2044cd-881c-462b-97b7-c1461aeff8e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.850727 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc2044cd-881c-462b-97b7-c1461aeff8e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:49.851921 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc2044cd-881c-462b-97b7-c1461aeff8e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:49.955698 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bc2044cd-881c-462b-97b7-c1461aeff8e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 23599 microversion: 2.20 time: 0.153724 Jan 10 12:48:49.957103 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 98/210] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:49 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 23599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:50.216527 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:50.217340 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:50.225744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.226570 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.227674 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.228359 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.384742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:50.393327 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6fcdc6ff-9f77-43a7-ad75-a956f2b1a73b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.181633 Jan 10 12:48:50.394574 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 113/211] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:50 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:50.584531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:50.585383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:50.593733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.594192 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.595001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.595674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.752394 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:50.760865 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-145ed486-71a5-4e6e-bd96-6e86c5bbe208 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1318 microversion: 2.1 time: 0.180700 Jan 10 12:48:50.761690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 99/212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:50 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:50.791131 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:50.792623 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:50.809166 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.809941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.811323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.811954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.969114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b5c2dd64-e910-4cd1-b338-58b65cfc89da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:50.971044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b5c2dd64-e910-4cd1-b338-58b65cfc89da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:50.982612 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5c2dd64-e910-4cd1-b338-58b65cfc89da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.983995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5c2dd64-e910-4cd1-b338-58b65cfc89da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.989175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5c2dd64-e910-4cd1-b338-58b65cfc89da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:50.989860 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5c2dd64-e910-4cd1-b338-58b65cfc89da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:50.998394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:51.010633 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8f589a05-af6d-4a94-9960-661f5a837e40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.229999 Jan 10 12:48:51.011237 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 114/213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:50 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:51.053375 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-1d686759-16e9-47f5-8d36-e2f2a2438103 req-ebed692b-5072-4d99-a7b1-5ce91304e55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27536579-386a-4119-81b7-0c48316a5fe1", "name": "network-vif-plugged", "status": "completed", "tag": "b9048143-da43-4ebf-95fd-5fad4bfb2326"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:51.055209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:51.055209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:48:51.067013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-1d686759-16e9-47f5-8d36-e2f2a2438103 req-ebed692b-5072-4d99-a7b1-5ce91304e55b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:51.068836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-1d686759-16e9-47f5-8d36-e2f2a2438103 req-ebed692b-5072-4d99-a7b1-5ce91304e55b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:51.084247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-1d686759-16e9-47f5-8d36-e2f2a2438103 req-ebed692b-5072-4d99-a7b1-5ce91304e55b service nova] Creating event network-vif-plugged:b9048143-da43-4ebf-95fd-5fad4bfb2326 for instance 27536579-386a-4119-81b7-0c48316a5fe1 on hv-cinder-maste Jan 10 12:48:51.100568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b5c2dd64-e910-4cd1-b338-58b65cfc89da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 24597 microversion: 2.20 time: 0.135484 Jan 10 12:48:51.100719 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-1d686759-16e9-47f5-8d36-e2f2a2438103 req-ebed692b-5072-4d99-a7b1-5ce91304e55b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051233 Jan 10 12:48:51.103150 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 100/214] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:50 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 24597 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:48:51.113553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 115/215] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:51.177059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-4d35700a-f2d6-455b-b6b4-93c963f25d33 req-1ae8b05d-9b6b-4935-8bf9-0112a1325dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ba5e7b-b15f-4980-aeee-11985b35b076", "tag": "cae30eac-1be6-45e1-a371-f67ef66276f8"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:51.179185 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:51.179185 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:48:51.210190 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-4d35700a-f2d6-455b-b6b4-93c963f25d33 req-1ae8b05d-9b6b-4935-8bf9-0112a1325dc8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:51.210773 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-4d35700a-f2d6-455b-b6b4-93c963f25d33 req-1ae8b05d-9b6b-4935-8bf9-0112a1325dc8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:51.238000 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-4d35700a-f2d6-455b-b6b4-93c963f25d33 req-1ae8b05d-9b6b-4935-8bf9-0112a1325dc8 service nova] Creating event network-changed:cae30eac-1be6-45e1-a371-f67ef66276f8 for instance 22ba5e7b-b15f-4980-aeee-11985b35b076 on hv-cinder-maste Jan 10 12:48:51.245771 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-4d35700a-f2d6-455b-b6b4-93c963f25d33 req-1ae8b05d-9b6b-4935-8bf9-0112a1325dc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073411 Jan 10 12:48:51.247041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 101/216] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:51.411224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:51.413168 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:51.422369 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:51.422814 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:51.423629 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:51.424060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:51.667098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:51.676308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a0d36294-2dcd-4bb0-aada-548ab13f0eab tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.269701 Jan 10 12:48:51.688626 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 116/217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:51 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:51.782596 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:51.787724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:51.805110 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:51.805741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:51.808922 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:51.810207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:52.028900 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:52.029609 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:52.042198 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:52.042654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:52.043455 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:52.043968 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:52.061416 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:52.076535 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6e9b64d4-9fc9-4de6-ac8f-f53f88f68e14 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1318 microversion: 2.1 time: 0.300766 Jan 10 12:48:52.078490 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 102/218] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:51 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:52.119020 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e33f87e0-d1e1-4884-813b-4eb51a3efada tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:52.120646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e33f87e0-d1e1-4884-813b-4eb51a3efada tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:52.134470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e33f87e0-d1e1-4884-813b-4eb51a3efada tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:52.135232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e33f87e0-d1e1-4884-813b-4eb51a3efada tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:52.136693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e33f87e0-d1e1-4884-813b-4eb51a3efada tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:52.137278 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e33f87e0-d1e1-4884-813b-4eb51a3efada tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:52.201448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:52.210327 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-498e538b-30b1-4aa4-aad8-7bdeb26d00e2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.185477 Jan 10 12:48:52.211379 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 117/219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:52 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:52.257823 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e33f87e0-d1e1-4884-813b-4eb51a3efada tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 25654 microversion: 2.20 time: 0.142848 Jan 10 12:48:52.260168 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 103/220] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:52 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 25654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:48:52.693643 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:52.694232 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:52.700286 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:52.700725 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:52.701653 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:52.702080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:52.961106 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:52.972002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-daef0a9f-6b53-4828-9622-ed891337a0e6 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1314 microversion: 2.1 time: 0.282156 Jan 10 12:48:52.981020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 118/221] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:52 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:53.094616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:53.095994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:53.114469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:53.115037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:53.115916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:53.116354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:53.228261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:53.228918 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:53.235478 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:53.235957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:53.236746 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:53.237183 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:53.337297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:53.349828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0f0a86eb-4dfc-45e4-9bbd-3fd13952a903 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1318 microversion: 2.1 time: 0.258628 Jan 10 12:48:53.350996 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 104/222] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:53 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:53.356832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7e0f5d2f-cc93-4027-856b-30442cdce23a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:53.358175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7e0f5d2f-cc93-4027-856b-30442cdce23a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:53.368245 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e0f5d2f-cc93-4027-856b-30442cdce23a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:53.368958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e0f5d2f-cc93-4027-856b-30442cdce23a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:53.371131 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e0f5d2f-cc93-4027-856b-30442cdce23a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:53.376818 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e0f5d2f-cc93-4027-856b-30442cdce23a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:53.417614 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:53.427276 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6fde3a41-affe-429a-979c-632cbd6fe012 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.203217 Jan 10 12:48:53.428240 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 119/223] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:53 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:53.498065 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7e0f5d2f-cc93-4027-856b-30442cdce23a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 26301 microversion: 2.20 time: 0.145121 Jan 10 12:48:53.499219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 105/224] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:53 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 26301 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:53.994243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:53.995053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:54.005450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:54.006150 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:54.008787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:54.009524 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:54.253824 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:54.271395 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bcc6d1bc-bc74-421f-8bf9-4076025759c7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1498 microversion: 2.1 time: 0.278771 Jan 10 12:48:54.273980 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 120/225] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:53 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1498 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:54.367000 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:54.367674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:54.394694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:54.395175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:54.398321 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:54.398773 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:54.444236 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:54.444855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:54.457229 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:54.457882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:54.458666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:54.459113 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:54.979245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:54.986622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8435fa88-b875-4bfb-8397-efba95349f4b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.546328 Jan 10 12:48:54.987209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 121/226] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:54 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:54.995800 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:55.006645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-394d370a-492d-4a3b-8f59-1713a8f1d0cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:55.009784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a131e32a-5251-4c17-8d7a-4b73a66be10c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1318 microversion: 2.1 time: 0.640679 Jan 10 12:48:55.010628 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 106/227] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:54 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:55.015390 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:55.015932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:55.022891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-394d370a-492d-4a3b-8f59-1713a8f1d0cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:55.029997 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-394d370a-492d-4a3b-8f59-1713a8f1d0cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:55.030454 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-394d370a-492d-4a3b-8f59-1713a8f1d0cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:55.031257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-394d370a-492d-4a3b-8f59-1713a8f1d0cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:55.031728 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-394d370a-492d-4a3b-8f59-1713a8f1d0cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:55.046493 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:55.046941 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:55.047781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:55.048267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:55.121648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Going to try to terminate instance {{(pid=123137) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:48:55.168422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-394d370a-492d-4a3b-8f59-1713a8f1d0cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 27351 microversion: 2.20 time: 0.179866 Jan 10 12:48:55.169885 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 122/228] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:54 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 27351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:55.413415 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-236cd213-5f66-4baa-910a-52c481247ad7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 204 len: 0 microversion: 2.1 time: 0.401330 Jan 10 12:48:55.414282 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 107/229] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:48:55 2022] DELETE /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:48:55.424484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:55.425034 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:55.435130 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:55.436487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:55.437650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:55.438317 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:55.991664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:56.002991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e281e892-4cb0-4391-b56c-a7069526799e tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1504 microversion: 2.1 time: 0.583610 Jan 10 12:48:56.005007 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 123/230] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:55 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:56.007275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:56.008363 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:56.022472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:56.025536 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:56.028866 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:56.031266 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:56.032356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:56.033407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:56.042138 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:56.047239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:56.048477 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:56.050852 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:56.395894 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:56.405136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-902b6557-4136-44ce-a1c6-6d2742125435 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.404069 Jan 10 12:48:56.415145 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 108/231] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:55 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:56.424621 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:56.433122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4aa3ad06-4c45-4b2f-837d-c4b9b548310f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1318 microversion: 2.1 time: 0.410228 Jan 10 12:48:56.433583 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ff6f53f1-8e2d-4db4-9af3-c588dc84cd20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:56.435306 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ff6f53f1-8e2d-4db4-9af3-c588dc84cd20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:56.445315 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 124/232] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:56 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:56.456136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff6f53f1-8e2d-4db4-9af3-c588dc84cd20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:56.457254 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff6f53f1-8e2d-4db4-9af3-c588dc84cd20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:56.459464 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff6f53f1-8e2d-4db4-9af3-c588dc84cd20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:56.460600 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff6f53f1-8e2d-4db4-9af3-c588dc84cd20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:56.584293 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ff6f53f1-8e2d-4db4-9af3-c588dc84cd20 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 27707 microversion: 2.20 time: 0.163420 Jan 10 12:48:56.584967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 109/233] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:56 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 27707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:57.022590 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:57.023477 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:57.036080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.040961 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.042217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.042663 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.202335 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-0aba6bd8-5e69-4d3e-bedf-709a61a9c215 req-1b5abdaa-1c20-47f8-bc16-0f4973c26c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ba5e7b-b15f-4980-aeee-11985b35b076", "name": "network-vif-plugged", "status": "completed", "tag": "cae30eac-1be6-45e1-a371-f67ef66276f8"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:57.204305 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:57.204305 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:48:57.238720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0aba6bd8-5e69-4d3e-bedf-709a61a9c215 req-1b5abdaa-1c20-47f8-bc16-0f4973c26c3d service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.241942 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0aba6bd8-5e69-4d3e-bedf-709a61a9c215 req-1b5abdaa-1c20-47f8-bc16-0f4973c26c3d service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.272360 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-0aba6bd8-5e69-4d3e-bedf-709a61a9c215 req-1b5abdaa-1c20-47f8-bc16-0f4973c26c3d service nova] Creating event network-vif-plugged:cae30eac-1be6-45e1-a371-f67ef66276f8 for instance 22ba5e7b-b15f-4980-aeee-11985b35b076 on hv-cinder-maste Jan 10 12:48:57.289756 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-0aba6bd8-5e69-4d3e-bedf-709a61a9c215 req-1b5abdaa-1c20-47f8-bc16-0f4973c26c3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090256 Jan 10 12:48:57.291054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 110/234] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:48:57.436245 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:57.437197 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:57.458189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.459275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.461479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.462309 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.548858 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:57.569715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d0ec78b7-ede6-4413-9a36-0b21653359f4 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1504 microversion: 2.1 time: 0.551239 Jan 10 12:48:57.580547 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 125/235] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:57 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1504 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:57.585864 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:57.586427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:57.609047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.609498 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.611866 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.618067 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.869281 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:57.887960 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8edeff6e-75af-4c79-887d-ac36d9fc70c0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.448866 Jan 10 12:48:57.888849 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 111/236] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:57 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:57.894517 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-df84f524-30f7-4638-a800-99b0c997df6d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:57.895914 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-df84f524-30f7-4638-a800-99b0c997df6d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:57.903614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-df84f524-30f7-4638-a800-99b0c997df6d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.904899 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-df84f524-30f7-4638-a800-99b0c997df6d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.906070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-df84f524-30f7-4638-a800-99b0c997df6d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:57.906716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-df84f524-30f7-4638-a800-99b0c997df6d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:57.977289 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:57.988671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b80392ea-234f-4e7a-a17d-38737792645f tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1318 microversion: 2.1 time: 0.406187 Jan 10 12:48:57.989975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 126/237] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:57 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:58.063501 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-df84f524-30f7-4638-a800-99b0c997df6d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 28124 microversion: 2.20 time: 0.170236 Jan 10 12:48:58.071696 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 112/238] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:57 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 28124 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:58.587711 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:58.588535 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:58.601830 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:58.602288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:58.604046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:58.609353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:58.740480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4bf4236f-f3b9-4b81-a72b-edba02c96115 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'create', calling method: .version_select at 0x7f7fcb1740d0>, body: {"keypair": {"name": "tempest-keypair-1180185655"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:58.786143 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:58.794323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4bf4236f-f3b9-4b81-a72b-edba02c96115 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:48:58.797433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0c2d2ec0-51cb-4b9f-a4d5-c89718aa2d60 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 200 len: 1462 microversion: 2.1 time: 0.214711 Jan 10 12:48:58.799452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 113/239] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:58 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 1462 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:58.840199 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4bf4236f-f3b9-4b81-a72b-edba02c96115 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for user 9bbc10f093cd4a3f9de4d874cfa8b831 and project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:48:58.863379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-6dffe758-8995-48b6-8a10-54869b84882b req-23760d50-a034-49b2-9b28-1cd0652985ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27536579-386a-4119-81b7-0c48316a5fe1", "name": "network-vif-deleted", "tag": "b9048143-da43-4ebf-95fd-5fad4bfb2326"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:58.871780 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:48:58.871780 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:48:58.910368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6dffe758-8995-48b6-8a10-54869b84882b req-23760d50-a034-49b2-9b28-1cd0652985ba service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:58.910966 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6dffe758-8995-48b6-8a10-54869b84882b req-23760d50-a034-49b2-9b28-1cd0652985ba service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:58.939480 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-6dffe758-8995-48b6-8a10-54869b84882b req-23760d50-a034-49b2-9b28-1cd0652985ba service nova] Creating event network-vif-deleted:b9048143-da43-4ebf-95fd-5fad4bfb2326 for instance 27536579-386a-4119-81b7-0c48316a5fe1 on hv-cinder-maste Jan 10 12:48:58.956826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-6dffe758-8995-48b6-8a10-54869b84882b req-23760d50-a034-49b2-9b28-1cd0652985ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126900 Jan 10 12:48:58.960641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 114/240] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:48:58.968789 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:58.969730 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:58.977465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:58.978061 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:58.979383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:58.980147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:59.214283 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:59.224074 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a70ffcf6-e872-4589-af7c-7437e0f42a95 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.261875 Jan 10 12:48:59.225685 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 115/241] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:58 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:59.240982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:59.241750 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:59.251806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:59.252483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:59.253346 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:59.253858 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:59.421174 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4bf4236f-f3b9-4b81-a72b-edba02c96115 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:48:59.425109 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4bf4236f-f3b9-4b81-a72b-edba02c96115 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for user 9bbc10f093cd4a3f9de4d874cfa8b831 and project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:48:59.443749 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:48:59.453158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e31c60ad-9e6d-462f-89e7-11677101bc48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1318 microversion: 2.1 time: 0.216775 Jan 10 12:48:59.463890 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 116/242] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:59 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:48:59.466497 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4bf4236f-f3b9-4b81-a72b-edba02c96115 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.245110 Jan 10 12:48:59.469002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 127/243] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Jan 10 12:48:58 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:48:59.475059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8dd7de1b-256d-4858-9f66-51050f1ab631 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:48:59.475059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8dd7de1b-256d-4858-9f66-51050f1ab631 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:59.481679 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8dd7de1b-256d-4858-9f66-51050f1ab631 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:59.482128 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8dd7de1b-256d-4858-9f66-51050f1ab631 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:59.483070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8dd7de1b-256d-4858-9f66-51050f1ab631 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:59.484024 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8dd7de1b-256d-4858-9f66-51050f1ab631 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:59.629568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8dd7de1b-256d-4858-9f66-51050f1ab631 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 28186 microversion: 2.20 time: 0.163646 Jan 10 12:48:59.630310 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 117/244] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:48:59 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 28186 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:48:59.816349 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:48:59.817065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 27536579-386a-4119-81b7-0c48316a5fe1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:48:59.830600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:59.830600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:59.831608 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:48:59.832148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:48:59.849389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] HTTP exception thrown: Instance 27536579-386a-4119-81b7-0c48316a5fe1 could not be found. Jan 10 12:48:59.850536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Returning 404 to user: Instance 27536579-386a-4119-81b7-0c48316a5fe1 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:48:59.851894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4bdc4406-3b5c-47c9-80d8-cbe267dceee9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1" status: 404 len: 111 microversion: 2.1 time: 0.040208 Jan 10 12:48:59.864521 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 128/245] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:48:59 2022] GET /compute/v2.1/servers/27536579-386a-4119-81b7-0c48316a5fe1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:49:00.010736 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1615519254", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "d9e7fcc6-2783-48be-a124-60b02ce632b7"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:00.242611 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:00.243552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:00.250710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:00.251825 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:00.252991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:00.253879 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:00.518941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:00.530459 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-12baae73-d319-43c3-ba22-40ed18d41256 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.290765 Jan 10 12:49:00.543206 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 129/246] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:00 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:00.548678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:00.549666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:00.559031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:00.559632 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:00.561263 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:00.562155 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:00.865622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:00.874416 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-76519185-6fb4-4949-976e-2e0d508e1d29 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1507 microversion: 2.1 time: 0.329805 Jan 10 12:49:00.875030 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 130/247] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:00 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:00.880336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3b4a4e9d-df18-402f-86c7-c44509679a8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:00.881602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3b4a4e9d-df18-402f-86c7-c44509679a8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:00.889717 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b4a4e9d-df18-402f-86c7-c44509679a8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:00.890513 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b4a4e9d-df18-402f-86c7-c44509679a8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:00.891632 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b4a4e9d-df18-402f-86c7-c44509679a8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:00.892282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b4a4e9d-df18-402f-86c7-c44509679a8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:01.012955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3b4a4e9d-df18-402f-86c7-c44509679a8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 28328 microversion: 2.20 time: 0.136689 Jan 10 12:49:01.014480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 131/248] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:00 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 28328 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:01.022996 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ff3d553-66f5-4833-ad6e-8f8440b38a4e"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:01.025080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:01.033656 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:01.035102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:01.036201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:01.036839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:01.134732 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] HTTP exception thrown: Invalid volume: volume 3ff3d553-66f5-4833-ad6e-8f8440b38a4e is already attached to instances: 03af44ba-8887-46a6-8431-a348b4376790 Jan 10 12:49:01.135346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Returning 400 to user: Invalid volume: volume 3ff3d553-66f5-4833-ad6e-8f8440b38a4e is already attached to instances: 03af44ba-8887-46a6-8431-a348b4376790 {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:49:01.136230 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fbab3129-dc38-4081-8b4e-dedaa980d309 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120408 Jan 10 12:49:01.137056 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 132/249] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:49:01 2022] POST /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:49:01.201742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:01.203680 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:01.226879 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:01.227508 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:01.228740 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:01.229471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:01.380770 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lazy-loading 'services' on Instance uuid 03af44ba-8887-46a6-8431-a348b4376790 {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:49:01.522097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-532a6683-cd48-4237-a1b7-aefc30bb3760 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790/os-volume_attachments/3ff3d553-66f5-4833-ad6e-8f8440b38a4e" status: 202 len: 0 microversion: 2.1 time: 0.325069 Jan 10 12:49:01.526274 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 133/250] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:49:01 2022] DELETE /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790/os-volume_attachments/3ff3d553-66f5-4833-ad6e-8f8440b38a4e => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:01.540074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-348021655", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87c964fb-a880-497c-9fae-14b2acc2e4e6"}], "security_groups": [{"name": "tempest-securitygroup--1686918859"}], "key_name": "tempest-keypair-1180185655", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:14.127179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] validate_networks() for [('d9e7fcc6-2783-48be-a124-60b02ce632b7', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:49:14.258219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] validate_networks() for [('87c964fb-a880-497c-9fae-14b2acc2e4e6', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:49:14.719035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:49:14.719457 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:49:14.719953 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:49:14.720330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:49:14.720736 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:49:14.729577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.730028 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.730905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.731338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.749417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Getting quotas for project 9c74d48e1e934088addee3d78ddbe485. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:49:14.753463 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Getting quotas for user 154d8ba69dce42fe85ae3a0ad7602bb2 and project 9c74d48e1e934088addee3d78ddbe485. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:49:14.767054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:49:14.769559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:49:14.818169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b5d24a17-19fd-425d-ae26-10979f07bafd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.812655 Jan 10 12:49:14.826894 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 118/251] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 14814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:49:14.826894 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a616f302-9a91-49c3-a49d-e80d498a5a66 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:14.826894 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a616f302-9a91-49c3-a49d-e80d498a5a66 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:14.831773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:49:14.831977 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a616f302-9a91-49c3-a49d-e80d498a5a66 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.832222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a616f302-9a91-49c3-a49d-e80d498a5a66 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.832827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:49:14.833006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a616f302-9a91-49c3-a49d-e80d498a5a66 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.833551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:49:14.833693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a616f302-9a91-49c3-a49d-e80d498a5a66 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.834340 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:49:14.834996 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:49:14.865999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.866854 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.870451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.871209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.881657 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a616f302-9a91-49c3-a49d-e80d498a5a66 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061769 Jan 10 12:49:14.882286 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 119/252] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:49:14 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:14.887058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:14.887371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:14.892679 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for project 42f048bd448f467aa0b37935d03a60e9. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:49:14.894786 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.895273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.896347 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for user 9bbc10f093cd4a3f9de4d874cfa8b831 and project 42f048bd448f467aa0b37935d03a60e9. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:49:14.896485 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:14.897002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:14.917103 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:49:14.920529 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:49:15.000650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-32e6d678-5cd3-471c-b339-d786b8ddcb54 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 13.466278 Jan 10 12:49:15.001314 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 134/253] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:49:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 13474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:49:15.010461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0feda780-17d4-4e15-a1f7-8403052fcd56 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:15.011564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0feda780-17d4-4e15-a1f7-8403052fcd56 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:15.024263 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0feda780-17d4-4e15-a1f7-8403052fcd56 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:15.024852 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0feda780-17d4-4e15-a1f7-8403052fcd56 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:15.025701 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0feda780-17d4-4e15-a1f7-8403052fcd56 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:15.026247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0feda780-17d4-4e15-a1f7-8403052fcd56 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:15.112002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:15.120209 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-69bdea2c-85ee-493b-9986-ba8d37d7534e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.236602 Jan 10 12:49:15.120798 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 120/254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:14 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:15.129976 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0a62f9a1-8cc7-4fa7-8f57-66cdc82120a9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:15.131150 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0a62f9a1-8cc7-4fa7-8f57-66cdc82120a9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:15.132719 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0feda780-17d4-4e15-a1f7-8403052fcd56 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 35085 microversion: 2.20 time: 0.130103 Jan 10 12:49:15.133493 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 135/255] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:15 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 35085 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:15.140566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9445a4f2-a3a0-4a56-8a88-f39e806dfac4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:15.141357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9445a4f2-a3a0-4a56-8a88-f39e806dfac4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:15.199709 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9445a4f2-a3a0-4a56-8a88-f39e806dfac4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:15.207240 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9445a4f2-a3a0-4a56-8a88-f39e806dfac4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1237 microversion: 2.1 time: 0.071541 Jan 10 12:49:15.207919 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 136/256] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:15 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:15.213561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-103391029", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "0493530f-49b3-4527-b75d-6de75567c16c"}]}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:15.230193 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0a62f9a1-8cc7-4fa7-8f57-66cdc82120a9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:15.238037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0a62f9a1-8cc7-4fa7-8f57-66cdc82120a9 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1214 microversion: 2.1 time: 0.116153 Jan 10 12:49:15.238653 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 121/257] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:15 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:16.140154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:16.140882 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:16.147595 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.148059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.148835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.149299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.295610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:16.304489 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d0ff9ce6-a869-448f-bddc-c8826ce92d90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1519 microversion: 2.1 time: 0.169903 Jan 10 12:49:16.316040 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 122/258] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:16 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:16.321731 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-20902c0f-9d03-45e0-a914-d56b5a20e55a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:16.322892 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-20902c0f-9d03-45e0-a914-d56b5a20e55a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:16.330176 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20902c0f-9d03-45e0-a914-d56b5a20e55a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.330988 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20902c0f-9d03-45e0-a914-d56b5a20e55a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.332074 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20902c0f-9d03-45e0-a914-d56b5a20e55a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.332724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20902c0f-9d03-45e0-a914-d56b5a20e55a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.428247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-20902c0f-9d03-45e0-a914-d56b5a20e55a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 35674 microversion: 2.20 time: 0.110609 Jan 10 12:49:16.429164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 123/259] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:16 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 35674 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:16.434941 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:16.436079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:16.443998 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.444725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.445716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.446356 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.512199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:16.520614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-194c2790-e1dc-4526-92a1-a80060e1698c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1289 microversion: 2.1 time: 0.089365 Jan 10 12:49:16.521531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 124/260] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:16 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:16.526250 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:16.527077 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:16.533647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.534089 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.535034 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:16.535465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:16.595643 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:16.603532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-18147887-d872-4649-b69d-ba0754252f7d tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1272 microversion: 2.1 time: 0.080811 Jan 10 12:49:16.604345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 125/261] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:16 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:16.777414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] validate_networks() for [('0493530f-49b3-4527-b75d-6de75567c16c', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:49:17.331824 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:17.332423 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:17.339637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.340094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.340891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.341374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.467627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:49:17.468305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:49:17.468993 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:49:17.469583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:49:17.470180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:49:17.482447 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.483008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.484650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.485090 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.511786 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:49:17.516053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for user 0513eaec53d241f398508dec85f017d7 and project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:49:17.522242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:17.530588 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-918da9bb-7d39-488e-9f34-abce1509986f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1499 microversion: 2.1 time: 0.204460 Jan 10 12:49:17.531450 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 126/262] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:17 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1499 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:17.536520 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-aba30363-a0b6-4bec-95eb-1a5c2ad505fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:17.537695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-aba30363-a0b6-4bec-95eb-1a5c2ad505fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:17.544310 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aba30363-a0b6-4bec-95eb-1a5c2ad505fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.544846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aba30363-a0b6-4bec-95eb-1a5c2ad505fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.545751 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aba30363-a0b6-4bec-95eb-1a5c2ad505fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.545857 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:49:17.546270 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aba30363-a0b6-4bec-95eb-1a5c2ad505fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.548403 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:49:17.601876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4407ffa0-06c8-4bae-a538-6fb5cb77576b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.392645 Jan 10 12:49:17.602958 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 137/263] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:49:17.608099 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:17.608744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:17.624833 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.625605 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.626587 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.627326 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.647269 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-aba30363-a0b6-4bec-95eb-1a5c2ad505fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 36241 microversion: 2.20 time: 0.114097 Jan 10 12:49:17.654188 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 127/264] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:17 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 36241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:17.661388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:17.662648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:17.676831 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.677392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.678372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.679060 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.720843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:17.736131 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8cdf6af3-99c6-4f4f-9e50-12606a9d76bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1295 microversion: 2.1 time: 0.131909 Jan 10 12:49:17.736730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 138/265] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:17 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:17.750045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ff44c4ce-abce-44a4-be91-97e57586c926 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:17.750919 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ff44c4ce-abce-44a4-be91-97e57586c926 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:17.835875 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ff44c4ce-abce-44a4-be91-97e57586c926 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:17.854730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ff44c4ce-abce-44a4-be91-97e57586c926 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1217 microversion: 2.1 time: 0.116775 Jan 10 12:49:17.855559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 139/266] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:17 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:17.877421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:17.877421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:17.877887 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:17.878885 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.879334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.880164 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:17.880766 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:17.886819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2806cf96-d391-49b4-befc-eac57254b8e5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1516 microversion: 2.1 time: 0.230989 Jan 10 12:49:17.887721 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 128/267] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:17 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:18.047275 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:18.055446 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-18cb143e-b8bd-43b4-b01a-482ff2ba0037 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.190015 Jan 10 12:49:18.056092 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 140/268] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:17 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:18.487754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-4ccccc4b-9e4f-4f66-9748-4311e05c829b req-62466e50-143e-4c9a-be78-3368130908a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6485c3a4-4c06-4444-8280-6ad10bda40bf", "tag": "6c4bfba1-33e4-4f74-a542-60eca89c42b1"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:18.492647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:18.492647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:18.502206 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-4ccccc4b-9e4f-4f66-9748-4311e05c829b req-62466e50-143e-4c9a-be78-3368130908a8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:18.502866 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-4ccccc4b-9e4f-4f66-9748-4311e05c829b req-62466e50-143e-4c9a-be78-3368130908a8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:18.516506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-4ccccc4b-9e4f-4f66-9748-4311e05c829b req-62466e50-143e-4c9a-be78-3368130908a8 service nova] Creating event network-changed:6c4bfba1-33e4-4f74-a542-60eca89c42b1 for instance 6485c3a4-4c06-4444-8280-6ad10bda40bf on hv-cinder-maste Jan 10 12:49:18.531919 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-4ccccc4b-9e4f-4f66-9748-4311e05c829b req-62466e50-143e-4c9a-be78-3368130908a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048931 Jan 10 12:49:18.533934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 129/269] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:18.661085 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-411bf9cc-ff0b-40f4-9913-d4fd6b2111f9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:18.662075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-411bf9cc-ff0b-40f4-9913-d4fd6b2111f9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:18.668742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-411bf9cc-ff0b-40f4-9913-d4fd6b2111f9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:18.669193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-411bf9cc-ff0b-40f4-9913-d4fd6b2111f9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:18.669978 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-411bf9cc-ff0b-40f4-9913-d4fd6b2111f9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:18.670440 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-411bf9cc-ff0b-40f4-9913-d4fd6b2111f9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:18.754183 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:18.755006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:18.761779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:18.762241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:18.763025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:18.763467 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:18.782681 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-411bf9cc-ff0b-40f4-9913-d4fd6b2111f9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 36834 microversion: 2.20 time: 0.125185 Jan 10 12:49:18.783348 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 141/270] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:18 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 36834 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:18.872326 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:18.873307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:18.884742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:18.885784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:18.888232 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:18.888913 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:18.919471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:18.930378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6d12eed8-53d7-4e00-9cdd-7bb6e5e28b01 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.180180 Jan 10 12:49:18.931590 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 130/271] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:18 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:18.984025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:18.991654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-92828154-6b14-4df8-8b42-ba1ec349dee3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1269 microversion: 2.1 time: 0.123460 Jan 10 12:49:18.992629 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 142/272] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:18 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:19.073542 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:19.074331 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:19.089188 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.089776 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.090747 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.091258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.266063 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:19.274506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-255ba812-a6b2-4828-83ba-c5ee9dee0a20 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.205329 Jan 10 12:49:19.275337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 131/273] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:19 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:19.365213 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:19.366176 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:19.372929 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.373708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.375389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.375863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.403424 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lazy-loading 'flavor' on Instance uuid e102ed1c-55c4-488a-9729-a99f58666989 {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:49:19.537330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cc0282fe-7dd4-44ea-87ed-1198303c0d66 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action" status: 200 len: 32 microversion: 2.1 time: 0.177421 Jan 10 12:49:19.537946 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 143/274] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:19 2022] POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 12:49:19.547281 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:19.548531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:19.555158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.555158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.555733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.557529 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.714563 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:19.723998 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-452b449d-8f94-4caa-ba9a-bf6363edb43a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.180686 Jan 10 12:49:19.724587 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 132/275] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:19 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:19.797326 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-81ed2348-a594-4c25-876f-d1c3c66fb4a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:19.798690 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-81ed2348-a594-4c25-876f-d1c3c66fb4a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:19.806401 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-81ed2348-a594-4c25-876f-d1c3c66fb4a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.806873 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-81ed2348-a594-4c25-876f-d1c3c66fb4a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.807715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-81ed2348-a594-4c25-876f-d1c3c66fb4a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.808219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-81ed2348-a594-4c25-876f-d1c3c66fb4a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.909262 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-81ed2348-a594-4c25-876f-d1c3c66fb4a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 37326 microversion: 2.20 time: 0.117091 Jan 10 12:49:19.915435 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 144/276] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:19 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 37326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:19.949127 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:19.949967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:19.964124 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.964575 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:19.965373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:19.965824 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.018671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:20.033399 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:20.038629 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.039127 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.040086 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.040526 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.130084 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:20.138220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-68efa156-fcc0-492e-a9f2-9aacc4aceaac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1275 microversion: 2.1 time: 0.124929 Jan 10 12:49:20.138928 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 145/277] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:20 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:20.159347 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:20.167729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e0213a32-12cd-4fa0-b3d8-d331a9f77e86 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.222781 Jan 10 12:49:20.168912 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 133/278] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:19 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:20.294489 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:20.295162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:20.306065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.306795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.307805 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.308445 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.459208 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:20.467758 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3c483e5f-8c24-407d-8885-e37b41c2afdd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.178675 Jan 10 12:49:20.468473 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 146/279] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:20 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:20.570639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-6448155d-3926-4bfa-8a4d-addc5da3589f req-961bc880-8707-440f-a834-c3412893ef8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04a2f28-f535-468a-ba8b-39cdc590147b", "tag": "31d2ebb9-0259-4cf8-a5d4-2cc46318279f"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:20.572448 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:20.572448 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:20.580587 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6448155d-3926-4bfa-8a4d-addc5da3589f req-961bc880-8707-440f-a834-c3412893ef8f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.581028 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6448155d-3926-4bfa-8a4d-addc5da3589f req-961bc880-8707-440f-a834-c3412893ef8f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.592301 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-6448155d-3926-4bfa-8a4d-addc5da3589f req-961bc880-8707-440f-a834-c3412893ef8f service nova] Creating event network-changed:31d2ebb9-0259-4cf8-a5d4-2cc46318279f for instance d04a2f28-f535-468a-ba8b-39cdc590147b on hv-cinder-maste Jan 10 12:49:20.597360 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-6448155d-3926-4bfa-8a4d-addc5da3589f req-961bc880-8707-440f-a834-c3412893ef8f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030342 Jan 10 12:49:20.598238 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 134/280] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:20.741553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:20.742164 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:20.749430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.749430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.750467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.750914 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.891939 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:20.899999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9b3360f0-8c9c-40c4-be8b-6f3c2da678b2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.161820 Jan 10 12:49:20.900532 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 147/281] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:20 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:20.923932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d4091af9-8e23-4b52-b01a-dbcf5a9f0e52 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:20.924891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d4091af9-8e23-4b52-b01a-dbcf5a9f0e52 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:20.930931 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d4091af9-8e23-4b52-b01a-dbcf5a9f0e52 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.931380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d4091af9-8e23-4b52-b01a-dbcf5a9f0e52 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:20.932191 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d4091af9-8e23-4b52-b01a-dbcf5a9f0e52 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:20.932622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d4091af9-8e23-4b52-b01a-dbcf5a9f0e52 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.047942 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d4091af9-8e23-4b52-b01a-dbcf5a9f0e52 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 37704 microversion: 2.20 time: 0.128663 Jan 10 12:49:21.048711 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 135/282] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:20 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 37704 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:21.158028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:21.160271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:21.167083 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.167839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.168917 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.169530 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.201540 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:21.203102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:21.216164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.216890 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.218208 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.218652 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.404004 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:21.415153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cad8c0e1-0c58-47e3-96cb-0efdedc6359d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.263086 Jan 10 12:49:21.424320 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:21.426780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 148/283] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:21 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:21.433956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-59d11e40-0409-431e-a756-3a329c9dc567 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.251247 Jan 10 12:49:21.434743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 136/284] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:21 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:21.485178 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:21.485780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:21.492010 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.492453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.493245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.493676 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.626805 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:21.634991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7a692299-6ccf-4c9e-9b91-0cd0815a8d6c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.154417 Jan 10 12:49:21.635582 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 149/285] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:21 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:21.917011 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:21.917714 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:21.924532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.925048 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:21.925827 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:21.926260 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.059886 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d037d109-9d44-4cd4-805f-32144f297b53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:22.062543 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d037d109-9d44-4cd4-805f-32144f297b53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:22.072777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:22.073010 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d037d109-9d44-4cd4-805f-32144f297b53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.073540 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d037d109-9d44-4cd4-805f-32144f297b53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.074700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d037d109-9d44-4cd4-805f-32144f297b53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.075352 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d037d109-9d44-4cd4-805f-32144f297b53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.082511 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-60a6cb51-eab3-41eb-98ed-bf9be9f0ee43 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.169156 Jan 10 12:49:22.083090 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 137/286] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:21 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:22.168759 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d037d109-9d44-4cd4-805f-32144f297b53 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 38162 microversion: 2.20 time: 0.112506 Jan 10 12:49:22.169504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 150/287] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:22 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 38162 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:49:22.433905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:22.434522 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:22.442626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.443201 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.444452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.445038 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.456639 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:22.457721 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:22.466036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.466536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.467827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.468362 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.663075 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:22.670511 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:22.671107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e77df03b-6a5f-41af-ba07-3f67d0e5c37b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.240879 Jan 10 12:49:22.671908 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 138/288] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:22 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:22.676519 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-b134755e-0502-4dfb-8848-32af0395e185 req-751d91e9-fc11-4dd2-a249-ffbef3022cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32155711-e404-4e2a-9808-fb51a91d4775", "tag": "95aaaa7e-e8c3-48fc-814b-58d23b3c5b2c"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:22.678466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:22.678466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:22.681678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-26833e4d-8c72-4e8f-9544-10890fcef57d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.229324 Jan 10 12:49:22.689365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 151/289] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:22 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:22.689365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:22.689365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:22.693926 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.694473 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.694841 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b134755e-0502-4dfb-8848-32af0395e185 req-751d91e9-fc11-4dd2-a249-ffbef3022cb1 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.695288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b134755e-0502-4dfb-8848-32af0395e185 req-751d91e9-fc11-4dd2-a249-ffbef3022cb1 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.695407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:22.695794 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:22.708638 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-b134755e-0502-4dfb-8848-32af0395e185 req-751d91e9-fc11-4dd2-a249-ffbef3022cb1 service nova] Creating event network-changed:95aaaa7e-e8c3-48fc-814b-58d23b3c5b2c for instance 32155711-e404-4e2a-9808-fb51a91d4775 on hv-cinder-maste Jan 10 12:49:22.713852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-b134755e-0502-4dfb-8848-32af0395e185 req-751d91e9-fc11-4dd2-a249-ffbef3022cb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040544 Jan 10 12:49:22.714478 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 139/290] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:22.837482 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:22.844853 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0c6eca9d-425c-401d-b9ff-3c1bb217cfc7 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.161520 Jan 10 12:49:22.845695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 152/291] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:22 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:23.100761 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:23.101348 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:23.107384 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.107946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.109348 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.109783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.181675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d98633c8-9915-4ce0-8e59-a93c5cd1b7f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:23.183553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d98633c8-9915-4ce0-8e59-a93c5cd1b7f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:23.190186 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d98633c8-9915-4ce0-8e59-a93c5cd1b7f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.190639 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d98633c8-9915-4ce0-8e59-a93c5cd1b7f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.191426 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d98633c8-9915-4ce0-8e59-a93c5cd1b7f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.191882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d98633c8-9915-4ce0-8e59-a93c5cd1b7f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.252646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:23.260544 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b0d1a9fb-ad1e-4cae-ae40-8e3601cda015 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.164793 Jan 10 12:49:23.267092 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 140/292] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:23 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:23.287409 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d98633c8-9915-4ce0-8e59-a93c5cd1b7f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 38183 microversion: 2.20 time: 0.109562 Jan 10 12:49:23.288110 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 153/293] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:23 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 38183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:49:23.688211 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:23.688819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:23.696743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.697237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.698035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.698495 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.698636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:23.699350 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:23.706863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.707304 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.708102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.708532 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.898229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:23.905657 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:23.905855 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b97085f5-bd2b-4b89-8f10-09a6d820eed4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.222050 Jan 10 12:49:23.906453 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 141/294] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:23 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:23.911459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:23.912216 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:23.914249 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7a4c14b5-2c0e-40bd-bf87-44014c1b059b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.219492 Jan 10 12:49:23.915072 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 154/295] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:23 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:23.920049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.920670 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:23.921474 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:23.921909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.063898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:24.071628 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0c8bae9b-8697-427f-99d5-795153bdfe2c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.163822 Jan 10 12:49:24.072207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 142/296] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:23 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:24.282203 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:24.282760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:24.289469 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.289915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.290717 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.291148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.299911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9bdb0c59-bdba-499d-8a34-702ecbfae993 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:24.300884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9bdb0c59-bdba-499d-8a34-702ecbfae993 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:24.307299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdb0c59-bdba-499d-8a34-702ecbfae993 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.307783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdb0c59-bdba-499d-8a34-702ecbfae993 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.308567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdb0c59-bdba-499d-8a34-702ecbfae993 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.309005 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdb0c59-bdba-499d-8a34-702ecbfae993 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.409964 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9bdb0c59-bdba-499d-8a34-702ecbfae993 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 200 len: 38302 microversion: 2.20 time: 0.114115 Jan 10 12:49:24.410877 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 143/297] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:24 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 38302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:49:24.421745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-292e1217-e6c6-4f79-a87c-b6112e2ebff7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:24.422336 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-292e1217-e6c6-4f79-a87c-b6112e2ebff7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:24.429149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:24.429642 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-292e1217-e6c6-4f79-a87c-b6112e2ebff7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.430098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-292e1217-e6c6-4f79-a87c-b6112e2ebff7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.430892 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-292e1217-e6c6-4f79-a87c-b6112e2ebff7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.431330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-292e1217-e6c6-4f79-a87c-b6112e2ebff7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.438033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-85836175-2637-442c-a4c9-279e6fefe8e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.161322 Jan 10 12:49:24.438790 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 155/298] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:24 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:24.456334 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-292e1217-e6c6-4f79-a87c-b6112e2ebff7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/ips" status: 200 len: 151 microversion: 2.20 time: 0.038894 Jan 10 12:49:24.456922 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 144/299] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jan 10 12:49:24 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:49:24.922529 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:24.923126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:24.929948 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:24.930816 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:24.932645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.933218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.934247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.934791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.938778 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.939226 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:24.940488 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:24.941126 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:25.184001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:25.191003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:25.199701 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5963dc69-5558-4147-b880-6b3c8aa78adf tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.280834 Jan 10 12:49:25.200600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 156/300] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:24 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:25.205180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:25.205778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:25.219605 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:25.220203 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:25.222405 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:25.222514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f46737f6-c302-4fbc-803d-eb9842547a81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.274476 Jan 10 12:49:25.222618 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:25.224001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 145/301] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:24 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:25.240734 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-e018b4a3-61d0-49e9-b520-c90905f8fed1 req-0290c998-a3f7-4851-b0af-0d5f31fca8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6485c3a4-4c06-4444-8280-6ad10bda40bf", "name": "network-vif-plugged", "status": "completed", "tag": "6c4bfba1-33e4-4f74-a542-60eca89c42b1"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:25.244718 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:25.244718 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:25.253646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-e018b4a3-61d0-49e9-b520-c90905f8fed1 req-0290c998-a3f7-4851-b0af-0d5f31fca8f6 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:25.254127 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-e018b4a3-61d0-49e9-b520-c90905f8fed1 req-0290c998-a3f7-4851-b0af-0d5f31fca8f6 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:25.284180 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-e018b4a3-61d0-49e9-b520-c90905f8fed1 req-0290c998-a3f7-4851-b0af-0d5f31fca8f6 service nova] Creating event network-vif-plugged:6c4bfba1-33e4-4f74-a542-60eca89c42b1 for instance 6485c3a4-4c06-4444-8280-6ad10bda40bf on hv-cinder-maste Jan 10 12:49:25.292133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-e018b4a3-61d0-49e9-b520-c90905f8fed1 req-0290c998-a3f7-4851-b0af-0d5f31fca8f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066722 Jan 10 12:49:25.295323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 146/302] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:25.395053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:25.402868 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b9f15032-9472-4fa4-a945-22dc5563fc82 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.201072 Jan 10 12:49:25.403684 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 157/303] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:25 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:25.457371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:25.458158 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:25.464531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:25.464966 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:25.465933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:25.466535 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:25.598766 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:25.608969 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-569c7b7d-5262-4849-ba34-1cea04b974f5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.156666 Jan 10 12:49:25.609790 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 147/304] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:25 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:26.230857 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:26.231485 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:26.239210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.239708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.240482 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.240910 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.246015 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:26.246632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:26.253894 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.254388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.255202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.260744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.459161 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:26.462193 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:26.467378 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b910e5db-206e-4d69-82d5-b8dbe0909da6 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.240610 Jan 10 12:49:26.468131 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 158/305] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:26 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:26.473293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:26.474082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:26.478379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8a2804b2-544d-48bc-a576-fd9d15ca1e0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.235953 Jan 10 12:49:26.478987 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 148/306] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:26 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:26.485338 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.485338 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.485338 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.485338 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.624905 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:26.625575 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:26.626202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:26.632294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.632785 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.633867 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:26.634313 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:26.634901 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2bab1ab5-b348-43dc-9816-206ef3ba44dd tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1314 microversion: 2.1 time: 0.164599 Jan 10 12:49:26.635901 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 159/307] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:26 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:26.793908 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:26.802124 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-23151fde-1668-4825-b06c-3fc7ffb38fda tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.180274 Jan 10 12:49:26.802704 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 149/308] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:26 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:27.087141 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:27.087934 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:27.096017 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.096487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.097563 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.098233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.131561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lazy-loading 'flavor' on Instance uuid 3436ba09-022f-4b36-987d-667c236d68d1 {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:49:27.323816 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-c3aad172-2ee0-4c9b-9997-4e58ee112334 req-2302ff69-15c2-4df0-9aa3-a1eda9fca60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04a2f28-f535-468a-ba8b-39cdc590147b", "name": "network-vif-plugged", "status": "completed", "tag": "31d2ebb9-0259-4cf8-a5d4-2cc46318279f"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:27.325616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:27.325616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:27.334154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-c3aad172-2ee0-4c9b-9997-4e58ee112334 req-2302ff69-15c2-4df0-9aa3-a1eda9fca60e service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.334853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-c3aad172-2ee0-4c9b-9997-4e58ee112334 req-2302ff69-15c2-4df0-9aa3-a1eda9fca60e service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.347956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-c3aad172-2ee0-4c9b-9997-4e58ee112334 req-2302ff69-15c2-4df0-9aa3-a1eda9fca60e service nova] Creating event network-vif-plugged:31d2ebb9-0259-4cf8-a5d4-2cc46318279f for instance d04a2f28-f535-468a-ba8b-39cdc590147b on hv-cinder-maste Jan 10 12:49:27.357843 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-c3aad172-2ee0-4c9b-9997-4e58ee112334 req-2302ff69-15c2-4df0-9aa3-a1eda9fca60e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037827 Jan 10 12:49:27.359463 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 150/309] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:27.486018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:27.488265 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:27.495171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.496412 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.497493 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.498556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.515548 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-eaa09ce1-31fd-4708-8371-c00550ce338c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 202 len: 0 microversion: 2.20 time: 0.432054 Jan 10 12:49:27.516765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 160/310] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:49:27 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:49:27.523004 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:27.524200 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:27.531577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.532291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.533877 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.534500 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.731934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:27.747835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b53fb7ef-4d18-42a9-b6ff-ce8152eb24dd tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.262480 Jan 10 12:49:27.748646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 151/311] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:27 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:27.750173 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:27.755573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:27.756457 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:27.763252 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.763781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.764742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.765405 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.768119 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ebfc82d8-49cb-4e40-9cda-bad012c43759 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.249647 Jan 10 12:49:27.768922 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 161/312] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:27 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:27.773755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:27.774530 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:27.785370 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.785822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:27.786622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:27.787063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:28.008684 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:28.016786 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:28.018380 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:28.018777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:28.020435 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-91b7b80e-ac30-4890-bc43-e9f63a598924 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.270582 Jan 10 12:49:28.032917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 152/313] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:27 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:28.039956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:28.040821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:28.043145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3f9e87a1-996f-4cae-b44a-cfd78142f632 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1499 microversion: 2.1 time: 0.273002 Jan 10 12:49:28.044451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 162/314] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:27 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1499 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:28.048621 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:28.049660 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:28.051244 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:28.052277 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:28.225765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:28.233299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9dfd027c-c597-4a6e-9921-01484d21b927 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.198021 Jan 10 12:49:28.234305 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 153/315] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:28 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:28.765013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:28.765775 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:28.773774 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:28.774261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:28.775246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:28.775719 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:28.785605 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:28.786454 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:28.792970 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:28.793429 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:28.794252 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:28.794678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:28.979557 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:28.983818 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:28.987739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-99b18d3f-1e3b-480b-9903-75a5cd19924b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.226279 Jan 10 12:49:28.988253 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 163/316] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:28 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:28.991871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2fc59375-48f3-4852-87f5-216654989977 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1363 microversion: 2.1 time: 0.209945 Jan 10 12:49:28.992417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 154/317] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:28 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:28.992612 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:28.993523 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:29.000262 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.000724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.001538 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.001977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.031050 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:49:29.039927 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:29.040544 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:29.046517 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.047104 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.048181 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.048605 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.119571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2994ecde-7c5b-43cf-8769-70ab6e53b062 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 204 len: 0 microversion: 2.1 time: 0.130009 Jan 10 12:49:29.120537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 164/318] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:49:28 2022] DELETE /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:49:29.129092 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:29.129792 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:29.135708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.136048 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.136836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.137274 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.211991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:29.220128 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:29.221656 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:29.222876 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7e8af3d1-1733-4b6c-9578-295677635930 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.186682 Jan 10 12:49:29.223648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 155/319] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:29 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:29.250414 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:29.251057 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:29.257386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.257833 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.258620 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:29.259052 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:29.288152 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:29.297427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-434be690-2fa8-49f8-ba2f-b27ba5a1b5b1 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1505 microversion: 2.1 time: 0.172271 Jan 10 12:49:29.298366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 165/320] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:29 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:29.402328 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:29.409879 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cc46665a-1d25-46be-a53f-c48a273a656e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.163505 Jan 10 12:49:29.410451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 156/321] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:29 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:30.004980 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:30.005563 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:30.010750 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:30.011480 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:30.012320 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.012770 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.013555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.014003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.017601 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.018217 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.019007 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.019432 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.212786 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:30.216261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:30.220804 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-dbb2d75e-9f9c-4bbf-89e6-229407fc9093 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.219557 Jan 10 12:49:30.221394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 166/322] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:29 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:30.224446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b584add3-4f5c-47db-afdc-75fa0a8808e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1549 microversion: 2.1 time: 0.218529 Jan 10 12:49:30.224997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 157/323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:30 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1549 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:30.240913 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:30.241508 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:30.242114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-203ba69d-8db6-4d43-b325-1ea14d476420 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:30.242605 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-203ba69d-8db6-4d43-b325-1ea14d476420 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:30.247901 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.248346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.248467 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-203ba69d-8db6-4d43-b325-1ea14d476420 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.248911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-203ba69d-8db6-4d43-b325-1ea14d476420 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.249124 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.249554 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.249681 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-203ba69d-8db6-4d43-b325-1ea14d476420 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.250118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-203ba69d-8db6-4d43-b325-1ea14d476420 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.366045 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-203ba69d-8db6-4d43-b325-1ea14d476420 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126958 Jan 10 12:49:30.366637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 158/324] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jan 10 12:49:30 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:30.374055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:30.375562 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:30.382958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.383652 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.384666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.385354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.453095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:30.461733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:30.463285 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:30.464479 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4133aefb-430f-449d-9bdf-b2c9aba3f0c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.227311 Jan 10 12:49:30.471451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 167/325] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:30 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:30.471451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:30.471451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:30.477419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.478474 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.478669 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:30.479121 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:30.585280 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:30.597203 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-988c8d9d-4149-4726-89af-ae6cb4015006 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1505 microversion: 2.1 time: 0.227548 Jan 10 12:49:30.597374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 159/326] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:30 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:30.649251 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:30.656721 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-da652619-5623-4cd9-99b9-0c203a595697 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.190718 Jan 10 12:49:30.657299 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 168/327] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:30 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:31.210702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-b824eb62-ebe3-4ef6-9625-c3780a72c82c req-86d2d698-1e52-4c9b-b055-39cb150d1d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32155711-e404-4e2a-9808-fb51a91d4775", "name": "network-vif-plugged", "status": "completed", "tag": "95aaaa7e-e8c3-48fc-814b-58d23b3c5b2c"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:31.212570 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:31.212570 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:31.221624 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b824eb62-ebe3-4ef6-9625-c3780a72c82c req-86d2d698-1e52-4c9b-b055-39cb150d1d87 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.222335 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b824eb62-ebe3-4ef6-9625-c3780a72c82c req-86d2d698-1e52-4c9b-b055-39cb150d1d87 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.234741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-b824eb62-ebe3-4ef6-9625-c3780a72c82c req-86d2d698-1e52-4c9b-b055-39cb150d1d87 service nova] Creating event network-vif-plugged:95aaaa7e-e8c3-48fc-814b-58d23b3c5b2c for instance 32155711-e404-4e2a-9808-fb51a91d4775 on hv-cinder-maste Jan 10 12:49:31.238812 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:31.239636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:31.241109 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-b824eb62-ebe3-4ef6-9625-c3780a72c82c req-86d2d698-1e52-4c9b-b055-39cb150d1d87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034745 Jan 10 12:49:31.241732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 160/328] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:31.248045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.249025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.250044 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.250936 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.401774 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:31.409394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-43bb15bb-7e60-47e4-ba83-40317c4e18ec tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.175387 Jan 10 12:49:31.409973 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 169/329] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:31 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:31.482947 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:31.483551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:31.490443 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.490891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.491700 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.492132 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.614537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:31.614952 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:31.621544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.622097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.622991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.623485 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.627499 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:31.637441 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:31.639253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:31.640408 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9eda6a56-fa10-4e6b-89af-40aef7d78698 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.161782 Jan 10 12:49:31.642510 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 161/330] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:31 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:31.673374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:31.674110 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:31.681537 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.681989 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.682826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.683427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.797390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:31.806037 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a29ae687-94a3-4183-b0ea-e11b0a8ac3fb tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1505 microversion: 2.1 time: 0.196142 Jan 10 12:49:31.806835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 170/331] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:31 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:31.811645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-492eeabd-6a66-4a46-aab9-284b50264afa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:31.812628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-492eeabd-6a66-4a46-aab9-284b50264afa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:31.819429 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-492eeabd-6a66-4a46-aab9-284b50264afa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.819913 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-492eeabd-6a66-4a46-aab9-284b50264afa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.820695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-492eeabd-6a66-4a46-aab9-284b50264afa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.821125 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-492eeabd-6a66-4a46-aab9-284b50264afa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.871478 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:31.879654 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d5b00ce6-5709-425f-8e93-ea8172453fd0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.209807 Jan 10 12:49:31.880259 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 162/332] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:31 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:31.885063 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-a1568d33-7fca-4a6e-ac4f-3d0282c7b02c req-53cbbcc3-dd57-4c3c-9c8c-00246232b21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04a2f28-f535-468a-ba8b-39cdc590147b", "tag": "31d2ebb9-0259-4cf8-a5d4-2cc46318279f"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:31.886626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:31.886626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:31.894523 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-a1568d33-7fca-4a6e-ac4f-3d0282c7b02c req-53cbbcc3-dd57-4c3c-9c8c-00246232b21a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:31.894964 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-a1568d33-7fca-4a6e-ac4f-3d0282c7b02c req-53cbbcc3-dd57-4c3c-9c8c-00246232b21a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:31.907279 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-a1568d33-7fca-4a6e-ac4f-3d0282c7b02c req-53cbbcc3-dd57-4c3c-9c8c-00246232b21a service nova] Creating event network-changed:31d2ebb9-0259-4cf8-a5d4-2cc46318279f for instance d04a2f28-f535-468a-ba8b-39cdc590147b on hv-cinder-maste Jan 10 12:49:31.912455 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-a1568d33-7fca-4a6e-ac4f-3d0282c7b02c req-53cbbcc3-dd57-4c3c-9c8c-00246232b21a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031031 Jan 10 12:49:31.913099 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 163/333] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:32.426722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:32.427423 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:32.434242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.434687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:32.435873 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.436308 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:32.575452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:32.583056 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b71681c7-ca38-4ea9-b42d-dca363044d3c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.160367 Jan 10 12:49:32.583663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 164/334] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:32 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:32.658228 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:32.658933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:32.665236 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.665669 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:32.666475 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.666909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:32.805818 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:32.813974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:32.815853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:32.817006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b2614d7e-9d37-4a85-bbfa-c4d2df8fa148 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.162666 Jan 10 12:49:32.817746 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 165/335] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:32 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:49:32.822699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:32.823543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:32.830801 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.831327 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:32.832946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.833871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:32.902632 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-492eeabd-6a66-4a46-aab9-284b50264afa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 1.094748 Jan 10 12:49:32.903411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 171/336] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:31 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:32.911878 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:32.912653 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:32.921802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.922304 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:32.923153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:32.923701 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:33.055375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:33.063690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a51d5b71-3d5f-420d-902e-2becef198a8c tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1505 microversion: 2.1 time: 0.244352 Jan 10 12:49:33.065729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 166/337] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:32 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:33.139023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:33.146760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-83c73452-0cd3-4d08-b780-6ccd63d501f0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.241880 Jan 10 12:49:33.147572 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 172/338] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:32 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:33.600300 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:33.601018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:33.614632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:33.615309 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:33.616125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:33.616541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:33.761332 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:33.770602 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e6d6236f-936e-4e4c-9f95-263ceb58747d tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.172860 Jan 10 12:49:33.770602 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 167/339] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:33 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:33.846621 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:33.847567 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:33.855892 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:33.855892 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:33.856627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:33.857147 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:33.915820 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bcae1592-eb79-4ac3-9d7a-c5435fd84e6c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:33.918561 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bcae1592-eb79-4ac3-9d7a-c5435fd84e6c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:33.928492 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcae1592-eb79-4ac3-9d7a-c5435fd84e6c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:33.929251 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcae1592-eb79-4ac3-9d7a-c5435fd84e6c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:33.930395 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcae1592-eb79-4ac3-9d7a-c5435fd84e6c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:33.931020 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcae1592-eb79-4ac3-9d7a-c5435fd84e6c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.006801 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bcae1592-eb79-4ac3-9d7a-c5435fd84e6c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.096148 Jan 10 12:49:34.007980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 168/340] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:33 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 12:49:34.021571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:34.033784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:34.035098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:34.036481 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-35855bc5-d37c-429c-80a3-5e310727b0d1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.205636 Jan 10 12:49:34.037046 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 173/341] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:33 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:34.085217 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:34.087074 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:34.096520 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:34.097254 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.097897 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:34.098407 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.165648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:34.167757 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:34.177005 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:34.181779 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.182619 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:34.183052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.206278 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d8ba69dce42fe85ae3a0ad7602bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c74d48e1e934088addee3d78ddbe485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:34.219100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-de1b05f8-a891-4bd1-bd7e-7fd91178af1b tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 200 len: 1463 microversion: 2.1 time: 0.140454 Jan 10 12:49:34.219973 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 169/342] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:34 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:34.272417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-14475fea-c0f4-4e47-ba28-c723b6e040c4 req-9e07401a-00ff-46b9-833c-f8b4d6e48f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6485c3a4-4c06-4444-8280-6ad10bda40bf", "name": "network-vif-deleted", "tag": "6c4bfba1-33e4-4f74-a542-60eca89c42b1"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:34.274002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:34.274002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:34.284106 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-14475fea-c0f4-4e47-ba28-c723b6e040c4 req-9e07401a-00ff-46b9-833c-f8b4d6e48f91 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:34.284551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-14475fea-c0f4-4e47-ba28-c723b6e040c4 req-9e07401a-00ff-46b9-833c-f8b4d6e48f91 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.296805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-14475fea-c0f4-4e47-ba28-c723b6e040c4 req-9e07401a-00ff-46b9-833c-f8b4d6e48f91 service nova] Creating event network-vif-deleted:6c4bfba1-33e4-4f74-a542-60eca89c42b1 for instance 6485c3a4-4c06-4444-8280-6ad10bda40bf on hv-cinder-maste Jan 10 12:49:34.302590 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-14475fea-c0f4-4e47-ba28-c723b6e040c4 req-9e07401a-00ff-46b9-833c-f8b4d6e48f91 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Jan 10 12:49:34.306214 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 170/343] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:49:34.363888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:34.372107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-914e508f-f739-47b4-a29e-e3c232d8e6de tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.212187 Jan 10 12:49:34.372765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 174/344] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:34 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:34.787433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:34.788175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:34.795107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:34.795554 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.796375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:34.796806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:34.938328 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:34.946333 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b8e5cdb4-ae5f-49eb-8e94-8ae6a5a207a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1317 microversion: 2.1 time: 0.163393 Jan 10 12:49:34.946921 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 171/345] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:34 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:35.018450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-eeae2b6d-40b3-4919-89dc-09c37152fd2d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:35.019796 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-eeae2b6d-40b3-4919-89dc-09c37152fd2d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:35.027299 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eeae2b6d-40b3-4919-89dc-09c37152fd2d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.027882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eeae2b6d-40b3-4919-89dc-09c37152fd2d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.028646 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eeae2b6d-40b3-4919-89dc-09c37152fd2d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.029273 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eeae2b6d-40b3-4919-89dc-09c37152fd2d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.058954 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:35.059709 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:35.066935 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.067377 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.068198 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.068635 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.106364 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-eeae2b6d-40b3-4919-89dc-09c37152fd2d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.091436 Jan 10 12:49:35.107293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 175/346] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:35 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 12:49:35.208896 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:35.217376 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:35.218879 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:35.220102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5a02960b-b0a8-4e29-aee2-e6d9ddb60e8f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.165687 Jan 10 12:49:35.220667 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 172/347] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:35 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:35.236523 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:35.237234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] [instance: 6485c3a4-4c06-4444-8280-6ad10bda40bf] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:35.244713 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.245098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.245937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.246367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.260817 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] HTTP exception thrown: Instance 6485c3a4-4c06-4444-8280-6ad10bda40bf could not be found. Jan 10 12:49:35.261438 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] Returning 404 to user: Instance 6485c3a4-4c06-4444-8280-6ad10bda40bf could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:49:35.262261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7293be92-fbb6-4d70-b7f1-66f8bf092f77 tempest-VolumesActionsTest-191862941 tempest-VolumesActionsTest-191862941-project] 10.222.0.13 "GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf" status: 404 len: 111 microversion: 2.1 time: 0.029980 Jan 10 12:49:35.262830 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 176/348] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:35 2022] GET /compute/v2.1/servers/6485c3a4-4c06-4444-8280-6ad10bda40bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:49:35.389255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:35.392783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:35.398952 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.399409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.400237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.400674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.558134 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:35.567268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8abb2440-8c85-4671-ab2a-2e6f55ed2695 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.182007 Jan 10 12:49:35.568376 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 173/349] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:35 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:35.962655 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:35.963264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:35.969707 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.970185 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:35.970962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:35.971355 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:36.117543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e30ad170-9b1c-4136-b3c3-75d78be78e7c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:36.119140 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e30ad170-9b1c-4136-b3c3-75d78be78e7c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:36.124576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:36.125836 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e30ad170-9b1c-4136-b3c3-75d78be78e7c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:36.126295 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e30ad170-9b1c-4136-b3c3-75d78be78e7c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:36.127090 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e30ad170-9b1c-4136-b3c3-75d78be78e7c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:36.127546 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e30ad170-9b1c-4136-b3c3-75d78be78e7c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:36.132889 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-08dbc17f-9370-4ac5-8414-bb26b3c0b473 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1507 microversion: 2.1 time: 0.173973 Jan 10 12:49:36.133551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 177/350] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:35 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:36.205933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e30ad170-9b1c-4136-b3c3-75d78be78e7c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.091966 Jan 10 12:49:36.207838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 174/351] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:36 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:36.238346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:36.239077 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:36.248514 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:36.249180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:36.250023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:36.250511 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:36.423975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:36.433218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:36.434726 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:36.436300 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3f34d832-d008-4685-8f70-7b3a8401ae2f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.201868 Jan 10 12:49:36.436864 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 178/352] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:36 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:36.584878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:36.585613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:36.592693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:36.593118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:36.593909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:36.594359 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:36.727624 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:36.738540 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-92edd3d7-f33e-4cee-a78a-c4bfd466964e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.157186 Jan 10 12:49:36.739216 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 175/353] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:36 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:37.220598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2a3adf54-30ae-4474-bee3-2e26b040f9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:37.220598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2a3adf54-30ae-4474-bee3-2e26b040f9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:37.226258 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2a3adf54-30ae-4474-bee3-2e26b040f9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:37.226709 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2a3adf54-30ae-4474-bee3-2e26b040f9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:37.227488 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2a3adf54-30ae-4474-bee3-2e26b040f9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:37.227966 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2a3adf54-30ae-4474-bee3-2e26b040f9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:37.455427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:37.456394 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:37.464305 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:37.464825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:37.465710 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:37.466206 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:37.776891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:37.784822 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:37.786411 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:37.787671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b1fcb8ec-03e9-4844-965f-e9b2bcaf9be4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.337167 Jan 10 12:49:37.788245 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 176/354] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:37 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:37.794084 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:37.794718 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:37.800590 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:37.801045 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:37.801820 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:37.802257 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:37.933151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:37.941322 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3742ce15-1d1f-4e12-b0de-0b4605fdefc2 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.151917 Jan 10 12:49:37.941896 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 177/355] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:37 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:38.806559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:38.807204 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:38.814267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:38.814742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:38.815540 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:38.816162 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:38.962582 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:38.970608 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:38.978982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:38.978982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-90968aed-baad-47ea-a631-48b4fc377368 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.171224 Jan 10 12:49:38.978982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 178/356] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:38 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:38.979269 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:38.979925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:38.985945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:38.986400 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:38.987182 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:38.987720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:39.119560 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:39.127392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9caae335-72fe-49c9-bc5e-0c1f816e4d40 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.151792 Jan 10 12:49:39.127986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 179/357] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:38 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:39.414282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2a3adf54-30ae-4474-bee3-2e26b040f9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 2.199025 Jan 10 12:49:39.415256 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 179/358] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:37 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:39.993289 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:39.993874 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:40.001067 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.001511 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.002388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.002847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.135763 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:40.144788 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:40.147107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:40.148074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:40.148484 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fcd7268e-b477-4cac-857b-7a17f0790514 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.159151 Jan 10 12:49:40.149136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 180/359] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:39 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:40.150317 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:40.158755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.159197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.160139 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.160580 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.306226 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:40.318794 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-13d85e03-4b51-4e52-a7d2-6f49728b2594 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.177809 Jan 10 12:49:40.319590 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 180/360] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:40 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:40.430597 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-80875dec-5df6-4c14-aef3-999f970e1def tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:40.431964 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-80875dec-5df6-4c14-aef3-999f970e1def tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:40.441485 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-80875dec-5df6-4c14-aef3-999f970e1def tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.441809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-80875dec-5df6-4c14-aef3-999f970e1def tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.442583 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-80875dec-5df6-4c14-aef3-999f970e1def tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.443016 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-80875dec-5df6-4c14-aef3-999f970e1def tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.652506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-80875dec-5df6-4c14-aef3-999f970e1def tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.227789 Jan 10 12:49:40.665519 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 181/361] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:40 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:40.671802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-de602acd-9ec1-4e6d-a1d1-eeb8b600b214 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bda9ccdd-7c4a-46de-9363-adfbf380dc84"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:40.672937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-de602acd-9ec1-4e6d-a1d1-eeb8b600b214 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:40.680072 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-de602acd-9ec1-4e6d-a1d1-eeb8b600b214 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.680579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-de602acd-9ec1-4e6d-a1d1-eeb8b600b214 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.681423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-de602acd-9ec1-4e6d-a1d1-eeb8b600b214 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:40.681918 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-de602acd-9ec1-4e6d-a1d1-eeb8b600b214 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:40.948103 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-de602acd-9ec1-4e6d-a1d1-eeb8b600b214 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279856 Jan 10 12:49:40.948992 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 181/362] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:49:40 2022] POST /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:41.167023 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:41.167770 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:41.175503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:41.175878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:41.176742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:41.177421 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:41.318207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:41.326695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:41.329146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:41.330363 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ca8db946-9a35-4c75-9002-aeb279e0e4ff tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.167634 Jan 10 12:49:41.330925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 182/363] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:41 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:41.342496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:41.343194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:41.350223 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:41.350636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:41.351630 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:41.352117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:41.493198 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:41.501255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-974ce016-eb86-4686-95ef-3b7c2a2793e6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.163599 Jan 10 12:49:41.501828 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 182/364] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:41 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:41.663686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e2ffa008-2016-4cbb-ac40-e87e2265199b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:41.664965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e2ffa008-2016-4cbb-ac40-e87e2265199b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:41.671857 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e2ffa008-2016-4cbb-ac40-e87e2265199b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:41.672563 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e2ffa008-2016-4cbb-ac40-e87e2265199b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:41.673559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e2ffa008-2016-4cbb-ac40-e87e2265199b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:41.674169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e2ffa008-2016-4cbb-ac40-e87e2265199b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:41.773528 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e2ffa008-2016-4cbb-ac40-e87e2265199b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.114332 Jan 10 12:49:41.777443 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 183/365] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:41 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:42.349728 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:42.350340 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:42.356860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:42.357572 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:42.358881 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:42.359477 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:42.521480 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:42.522913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:42.533460 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:42.534476 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:42.536120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:42.536848 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:42.565944 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:42.589971 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:42.593592 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:42.595982 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8d244915-18d9-4659-b5e7-f90e2220a076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.250439 Jan 10 12:49:42.598433 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 183/366] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:42 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:42.759018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:42.777434 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c56b0cd6-2e38-465a-8fd2-26273306f2c3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.262378 Jan 10 12:49:42.779838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 184/367] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:42 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:42.793798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ac58a34a-e46a-49cb-a601-a4f3bb326f45 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:42.795295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ac58a34a-e46a-49cb-a601-a4f3bb326f45 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:42.807241 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ac58a34a-e46a-49cb-a601-a4f3bb326f45 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:42.807693 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ac58a34a-e46a-49cb-a601-a4f3bb326f45 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:42.811294 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ac58a34a-e46a-49cb-a601-a4f3bb326f45 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:42.812101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ac58a34a-e46a-49cb-a601-a4f3bb326f45 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:42.925068 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ac58a34a-e46a-49cb-a601-a4f3bb326f45 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.143862 Jan 10 12:49:42.930061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 184/368] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:42 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:43.621288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:43.622146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:43.632046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:43.632506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:43.633297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:43.633740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:43.768993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:43.777674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:43.779171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:43.780355 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bb9c184e-501c-4c37-b9ed-6066b464b5c6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.165562 Jan 10 12:49:43.780926 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 185/369] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:43 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:43.796583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:43.797287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:43.806151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:43.807246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:43.808225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:43.808666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:43.937164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ae07e6c0-c40e-4d47-b81b-18e66ac05e62 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:43.938094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ae07e6c0-c40e-4d47-b81b-18e66ac05e62 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:43.944781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ae07e6c0-c40e-4d47-b81b-18e66ac05e62 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:43.945241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ae07e6c0-c40e-4d47-b81b-18e66ac05e62 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:43.946041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ae07e6c0-c40e-4d47-b81b-18e66ac05e62 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:43.946479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ae07e6c0-c40e-4d47-b81b-18e66ac05e62 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:43.950482 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:43.958387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9c6a2504-0600-411d-997c-92f382201520 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.165748 Jan 10 12:49:43.959252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 185/370] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:43 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:44.802522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:44.804256 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:44.814822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:44.815589 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:44.816915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:44.817639 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:44.960096 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:44.968551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:44.970128 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:44.971301 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c2899eb3-e542-4f84-86d1-d8a373f262a7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.175088 Jan 10 12:49:44.971897 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 186/371] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:44 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:44.976508 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:44.977103 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:44.983110 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:44.983578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:44.984362 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:44.984796 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:45.131960 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:45.140725 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-39a405ba-3710-43fa-b4d5-7eaada3efa65 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.167797 Jan 10 12:49:45.141451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 187/372] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:44 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:45.991031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:45.992514 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:45.999153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:45.999900 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:46.000786 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:46.001756 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:46.140888 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ae07e6c0-c40e-4d47-b81b-18e66ac05e62 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 2.207663 Jan 10 12:49:46.143264 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 186/373] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:43 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:46.158631 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:46.160142 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:46.221899 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:46.229213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:46.230328 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:46.231904 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:46.284875 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:46.295270 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:46.296948 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:46.298259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e64e544d-abd6-47d4-9fb3-011cf01133af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.312492 Jan 10 12:49:46.299262 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 188/374] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:45 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:46.457933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:46.466409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e543b734-45c5-4f07-aa9b-d6a538ed36a0 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.311953 Jan 10 12:49:46.467116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 187/375] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:46 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:47.154234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-241566d8-69b9-4ec1-a79b-8165798bb5dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:47.155172 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-241566d8-69b9-4ec1-a79b-8165798bb5dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:47.163423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-241566d8-69b9-4ec1-a79b-8165798bb5dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:47.164174 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-241566d8-69b9-4ec1-a79b-8165798bb5dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:47.165931 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-241566d8-69b9-4ec1-a79b-8165798bb5dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:47.166531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-241566d8-69b9-4ec1-a79b-8165798bb5dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:47.291534 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-241566d8-69b9-4ec1-a79b-8165798bb5dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.141632 Jan 10 12:49:47.292329 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 189/376] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:47 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:47.318553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:47.320521 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:47.330889 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:47.332565 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:47.333605 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:47.334340 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:47.485689 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:47.486616 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:47.494814 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:47.495566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:47.496537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:47.497117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:47.502916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:47.511958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:47.514174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:47.515913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-af15965f-086d-4b4e-bf38-3052a4399d46 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.201808 Jan 10 12:49:47.516646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 188/377] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:47 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:47.714109 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:47.724731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2438930a-5e2a-4e18-9a65-e953d81f424e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.243038 Jan 10 12:49:47.725404 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 190/378] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:47 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:48.302448 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-998fa76c-0d99-42fb-be0f-20f767703b6f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:48.303318 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-998fa76c-0d99-42fb-be0f-20f767703b6f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:48.310311 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-998fa76c-0d99-42fb-be0f-20f767703b6f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:48.310766 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-998fa76c-0d99-42fb-be0f-20f767703b6f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:48.311598 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-998fa76c-0d99-42fb-be0f-20f767703b6f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:48.312070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-998fa76c-0d99-42fb-be0f-20f767703b6f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:48.408226 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-998fa76c-0d99-42fb-be0f-20f767703b6f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.109218 Jan 10 12:49:48.411637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 189/379] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:48 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:48.535157 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:48.536241 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:48.553777 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:48.556030 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:48.557183 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:48.557731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:48.744813 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:48.745855 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:48.756169 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:48.760227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:48.760962 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:48.762440 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:48.763231 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:48.768688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:48.770544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:48.772242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a6fda085-757d-4e78-b12b-a48cfd9437b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.241735 Jan 10 12:49:48.783721 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 191/380] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:48 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:48.936272 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:48.947965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c2a7f14b-4397-4f78-ac57-d5e6d4aab27d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.208871 Jan 10 12:49:48.957436 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 190/381] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:48 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:49.420201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-45af31af-e02e-4db1-a49b-3bf63513dfda tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:49.421313 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-45af31af-e02e-4db1-a49b-3bf63513dfda tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:49.431720 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45af31af-e02e-4db1-a49b-3bf63513dfda tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.432409 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45af31af-e02e-4db1-a49b-3bf63513dfda tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:49.433275 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45af31af-e02e-4db1-a49b-3bf63513dfda tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.433776 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-45af31af-e02e-4db1-a49b-3bf63513dfda tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:49.575410 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-45af31af-e02e-4db1-a49b-3bf63513dfda tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 14 microversion: 2.1 time: 0.159585 Jan 10 12:49:49.577570 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 192/382] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:49 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:49.719307 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bda9ccdd-7c4a-46de-9363-adfbf380dc84"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:49.721067 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:49.729210 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.729954 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:49.730784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.731565 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:49.793019 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:49.794008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:49.817150 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.817647 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:49.823403 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.824113 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:49.824674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] HTTP exception thrown: Invalid volume: volume bda9ccdd-7c4a-46de-9363-adfbf380dc84 is already attached to instances: 32155711-e404-4e2a-9808-fb51a91d4775 Jan 10 12:49:49.825579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Returning 400 to user: Invalid volume: volume bda9ccdd-7c4a-46de-9363-adfbf380dc84 is already attached to instances: 32155711-e404-4e2a-9808-fb51a91d4775 {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:49:49.826536 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-023716ed-9f37-42d2-8bef-d91f34a0b387 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111245 Jan 10 12:49:49.827471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 191/383] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:49:49 2022] POST /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:49:49.926309 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:49.927123 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:49.938730 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.941104 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:49.942432 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:49.942904 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.058675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:50.069816 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:50.071635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:50.072946 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0d56dc87-9344-479d-981b-3c748b685b3a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.286390 Jan 10 12:49:50.073676 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 193/384] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:49 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:49:50.094094 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:50.096192 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:50.113926 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.115290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.116441 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.118637 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.186917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lazy-loading 'services' on Instance uuid 32155711-e404-4e2a-9808-fb51a91d4775 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:49:50.397097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-18149cca-2633-49d1-94f1-6f5a16d3511a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments/bda9ccdd-7c4a-46de-9363-adfbf380dc84" status: 202 len: 0 microversion: 2.1 time: 0.474631 Jan 10 12:49:50.402545 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 192/385] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:49:49 2022] DELETE /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments/bda9ccdd-7c4a-46de-9363-adfbf380dc84 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:50.411446 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:50.419921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cc3d5df3-4469-4bab-bb84-3308c088bd62 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1502 microversion: 2.1 time: 0.345319 Jan 10 12:49:50.420514 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 194/386] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:50 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1502 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:50.427217 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5bb04e52-8d78-4eb2-9c71-45f0f3073460 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:50.428433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5bb04e52-8d78-4eb2-9c71-45f0f3073460 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:50.435668 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5bb04e52-8d78-4eb2-9c71-45f0f3073460 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.436520 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5bb04e52-8d78-4eb2-9c71-45f0f3073460 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.437479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5bb04e52-8d78-4eb2-9c71-45f0f3073460 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.438068 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5bb04e52-8d78-4eb2-9c71-45f0f3073460 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.439827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "316d1a8e-9d42-42f4-90e6-57e208175f02"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:50.443066 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:50.450284 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.450927 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.452455 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.453680 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.484798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] HTTP exception thrown: Cannot 'attach_volume' instance e102ed1c-55c4-488a-9729-a99f58666989 while it is in vm_state rescued Jan 10 12:49:50.486020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Returning 409 to user: Cannot 'attach_volume' instance e102ed1c-55c4-488a-9729-a99f58666989 while it is in vm_state rescued {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:49:50.486861 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bcc98e82-66a5-4f30-a338-74fde6717fa4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052222 Jan 10 12:49:50.487413 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 195/387] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:49:50 2022] POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 10 12:49:50.496976 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-711a3f3e-9b0a-4f0a-a98e-d070e7c068e8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:50.497346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-711a3f3e-9b0a-4f0a-a98e-d070e7c068e8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:50.503406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5bb04e52-8d78-4eb2-9c71-45f0f3073460 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080235 Jan 10 12:49:50.504247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-711a3f3e-9b0a-4f0a-a98e-d070e7c068e8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.504834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-711a3f3e-9b0a-4f0a-a98e-d070e7c068e8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.505625 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-711a3f3e-9b0a-4f0a-a98e-d070e7c068e8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.506061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-711a3f3e-9b0a-4f0a-a98e-d070e7c068e8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.514765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 193/388] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:49:50 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:50.593150 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cc94fd41-bab6-4cca-8df1-f3f8dfb13dcb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:50.593266 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-711a3f3e-9b0a-4f0a-a98e-d070e7c068e8 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action" status: 202 len: 0 microversion: 2.1 time: 0.100269 Jan 10 12:49:50.593934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cc94fd41-bab6-4cca-8df1-f3f8dfb13dcb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:50.594173 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 196/389] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:50 2022] POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:49:50.606262 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc94fd41-bab6-4cca-8df1-f3f8dfb13dcb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.606848 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc94fd41-bab6-4cca-8df1-f3f8dfb13dcb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.607779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc94fd41-bab6-4cca-8df1-f3f8dfb13dcb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.608353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc94fd41-bab6-4cca-8df1-f3f8dfb13dcb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.640826 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:50.641556 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:50.656766 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.657230 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.658795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:50.659412 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:50.705336 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cc94fd41-bab6-4cca-8df1-f3f8dfb13dcb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 7815 microversion: 2.1 time: 0.118097 Jan 10 12:49:50.709431 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 194/390] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:50 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 7815 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:50.883346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:50.896005 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d51362dd-dde6-460a-b84d-f1de9fdee433 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1510 microversion: 2.1 time: 0.296514 Jan 10 12:49:50.896871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 197/391] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:50 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1510 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:51.092055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:51.092919 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:51.108429 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.109920 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:51.111595 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.115384 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:51.442576 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:51.458841 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:51.464321 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:51.467229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-75f242ef-42c1-4c9c-a4d4-a121e6db74cc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.378890 Jan 10 12:49:51.468446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 195/392] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:51 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:51.526148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d3a69ff8-50d4-4923-8499-adccc114c8a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:51.527194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d3a69ff8-50d4-4923-8499-adccc114c8a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:51.540130 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d3a69ff8-50d4-4923-8499-adccc114c8a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.541945 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d3a69ff8-50d4-4923-8499-adccc114c8a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:51.543015 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d3a69ff8-50d4-4923-8499-adccc114c8a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.545374 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d3a69ff8-50d4-4923-8499-adccc114c8a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:51.630119 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d3a69ff8-50d4-4923-8499-adccc114c8a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108514 Jan 10 12:49:51.630915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 198/393] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:49:51 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:51.719533 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ca9ae485-8049-4706-b2f8-202501b19863 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:51.720903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ca9ae485-8049-4706-b2f8-202501b19863 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:51.742080 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca9ae485-8049-4706-b2f8-202501b19863 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.742885 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca9ae485-8049-4706-b2f8-202501b19863 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:51.743815 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca9ae485-8049-4706-b2f8-202501b19863 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.744625 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca9ae485-8049-4706-b2f8-202501b19863 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:51.913794 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:51.914404 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:51.921058 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.922208 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:51.923162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:51.923784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:52.084310 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:52.096099 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-20f5a5df-1324-4a2a-bf33-d4775dda62ec tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1510 microversion: 2.1 time: 0.186133 Jan 10 12:49:52.106682 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 199/394] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:51 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:52.489586 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:52.492249 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:52.519555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:52.521424 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:52.528198 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:52.530107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:52.711553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:52.719867 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:52.721627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:52.722791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e21a5cee-032b-467c-90c4-ada318e4fb69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.239981 Jan 10 12:49:52.735280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 200/395] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:52 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:52.740218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ec308f40-bb98-4b93-9a31-74882b4fe1a8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:52.741357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ec308f40-bb98-4b93-9a31-74882b4fe1a8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:52.748122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec308f40-bb98-4b93-9a31-74882b4fe1a8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:52.748763 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec308f40-bb98-4b93-9a31-74882b4fe1a8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:52.749736 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec308f40-bb98-4b93-9a31-74882b4fe1a8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:52.750178 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec308f40-bb98-4b93-9a31-74882b4fe1a8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:52.782321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ec308f40-bb98-4b93-9a31-74882b4fe1a8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045736 Jan 10 12:49:52.782820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 201/396] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:49:52 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:49:52.940525 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-293568183", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "0493530f-49b3-4527-b75d-6de75567c16c"}]}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:52.994950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] validate_networks() for [('0493530f-49b3-4527-b75d-6de75567c16c', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:49:53.373955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:49:53.374537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:49:53.375241 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:49:53.375851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:49:53.376398 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:49:53.387760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:53.388210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:53.389014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:53.389445 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:53.409769 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:49:53.414387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Getting quotas for user 0513eaec53d241f398508dec85f017d7 and project cc2f029676f249c681ad86a3f68525e4. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:49:53.425579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:49:53.427947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:49:53.479471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-64aaa711-2c93-4d8d-bcee-52a15e1c235c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542627 Jan 10 12:49:53.485013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 202/397] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:49:53.485013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:53.485530 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:53.491740 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:53.492289 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:53.493106 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:53.493539 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:53.637835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:53.645133 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-72b930d6-b6f8-4dcf-bfa4-2f7dafbc8998 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1510 microversion: 2.1 time: 0.164074 Jan 10 12:49:53.645702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 203/398] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:53 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:53.651061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d1a96f54-39e4-4c44-a296-084c6f3d59e0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:53.651061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d1a96f54-39e4-4c44-a296-084c6f3d59e0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:53.704190 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d1a96f54-39e4-4c44-a296-084c6f3d59e0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:53.710813 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d1a96f54-39e4-4c44-a296-084c6f3d59e0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1217 microversion: 2.1 time: 0.064171 Jan 10 12:49:53.711762 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 204/399] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:53 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:53.742129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:53.743049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:53.748960 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:53.749411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:53.750195 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:53.750631 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:53.890380 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:53.898293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:53.899977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:53.901134 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0e30db26-5a67-4103-926a-d8aa5bd54f4d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.163169 Jan 10 12:49:53.901698 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 205/400] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:53 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:49:54.419553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ca9ae485-8049-4706-b2f8-202501b19863 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 19342 microversion: 2.1 time: 2.705878 Jan 10 12:49:54.420208 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 196/401] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:51 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 19342 bytes in 2708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:49:54.662641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:54.663280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:54.672063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:54.672787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:54.673812 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:54.674411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:54.730530 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:54.731589 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:54.744573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:54.745024 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:54.745856 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:54.746293 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:54.847343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:54.857495 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b39ece07-df37-47ea-bc3c-364496b6c445 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1269 microversion: 2.1 time: 0.132616 Jan 10 12:49:54.858724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 197/402] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:54 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:54.890597 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:54.899458 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-af418b7a-573d-4377-97c2-2a613e048dab tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1510 microversion: 2.1 time: 0.240615 Jan 10 12:49:54.900523 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 206/403] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:54 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:54.920498 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:54.921290 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:54.928427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:54.929121 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:54.930175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:54.931352 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:55.077209 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:55.085510 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:55.087254 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:55.089194 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fee32a14-7905-4f71-9751-f90f06892ca6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.172533 Jan 10 12:49:55.089855 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 198/404] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:54 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:49:55.432431 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-aeb2219c-009f-4b2f-92dc-b1ddc29ba272 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:55.433803 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-aeb2219c-009f-4b2f-92dc-b1ddc29ba272 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:55.443166 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aeb2219c-009f-4b2f-92dc-b1ddc29ba272 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:55.444643 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aeb2219c-009f-4b2f-92dc-b1ddc29ba272 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:55.446081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aeb2219c-009f-4b2f-92dc-b1ddc29ba272 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:55.451116 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-aeb2219c-009f-4b2f-92dc-b1ddc29ba272 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:55.582851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-aeb2219c-009f-4b2f-92dc-b1ddc29ba272 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 20053 microversion: 2.1 time: 0.154956 Jan 10 12:49:55.588786 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 207/405] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:55 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 20053 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:49:55.813391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1216454222", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "5af1f618-4b76-4aff-a2a2-5ebba4d5c873"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:55.880322 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:55.881262 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:55.884747 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] validate_networks() for [('5af1f618-4b76-4aff-a2a2-5ebba4d5c873', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:49:55.890457 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:55.890915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:55.891787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:55.892225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:55.966669 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:55.979892 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-541c2f11-9fca-464a-8fab-90088d3a0bc1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1275 microversion: 2.1 time: 0.104635 Jan 10 12:49:55.981093 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 208/406] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:55 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:55.986194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:55.987041 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:56.003334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.003873 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.004980 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.005116 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.380486 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:56.390022 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-08110445-b9a3-457f-b848-069a303fe737 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1510 microversion: 2.1 time: 0.407337 Jan 10 12:49:56.405346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 209/407] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:55 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:56.410600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:56.414222 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:56.425382 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.425850 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.426686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.427209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.547934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:49:56.548359 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:49:56.549016 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:49:56.549600 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:49:56.550191 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:49:56.565059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.567821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.569566 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.571498 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.607072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Getting quotas for project 36b1b002256e43eba62e736d945f9049. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:49:56.619211 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Getting quotas for user 90f35219a70d4e0596a6c28bd9ef9acc and project 36b1b002256e43eba62e736d945f9049. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:49:56.645627 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:49:56.655410 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:49:56.720108 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:56.736693 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:56.738485 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:56.739789 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-288adce5-305f-46c5-bae6-ee8ae9589122 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1742 microversion: 2.20 time: 0.333106 Jan 10 12:49:56.740561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 210/408] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:56 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1742 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:56.784257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7bddeeae-c3fb-4d4f-83ad-a7c825875e8d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:56.784257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7bddeeae-c3fb-4d4f-83ad-a7c825875e8d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:56.785636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4f896497-9019-4b06-a974-6a3850f4e8d9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976373 Jan 10 12:49:56.786755 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 199/409] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:49:56.795576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7bddeeae-c3fb-4d4f-83ad-a7c825875e8d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.796065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7bddeeae-c3fb-4d4f-83ad-a7c825875e8d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.796862 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7bddeeae-c3fb-4d4f-83ad-a7c825875e8d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:56.797225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a907056d-ef8f-4e2d-98c3-99257d0a4513 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:56.797345 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7bddeeae-c3fb-4d4f-83ad-a7c825875e8d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:56.797838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a907056d-ef8f-4e2d-98c3-99257d0a4513 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:56.908576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7bddeeae-c3fb-4d4f-83ad-a7c825875e8d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 22111 microversion: 2.1 time: 0.155295 Jan 10 12:49:56.909869 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 211/410] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:56 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 22111 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:49:56.941955 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a907056d-ef8f-4e2d-98c3-99257d0a4513 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:56.953193 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a907056d-ef8f-4e2d-98c3-99257d0a4513 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1219 microversion: 2.1 time: 0.160229 Jan 10 12:49:56.954726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 200/411] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:56 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:49:56.998416 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:56.999126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:57.012057 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.012503 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.013520 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.014118 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.168943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-5cb84389-cacc-40f7-a4e5-9931602e4eb7 req-60f3da56-d02b-4431-8cfc-2b743db8eb1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b25262-b3d3-43a6-a674-7bd204e45e31", "tag": "d7de2099-ce7e-43d9-9a27-d9371be7127a"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:57.171243 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:57.171243 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:49:57.186774 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-5cb84389-cacc-40f7-a4e5-9931602e4eb7 req-60f3da56-d02b-4431-8cfc-2b743db8eb1c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.188159 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-5cb84389-cacc-40f7-a4e5-9931602e4eb7 req-60f3da56-d02b-4431-8cfc-2b743db8eb1c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.216602 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-5cb84389-cacc-40f7-a4e5-9931602e4eb7 req-60f3da56-d02b-4431-8cfc-2b743db8eb1c service nova] Creating event network-changed:d7de2099-ce7e-43d9-9a27-d9371be7127a for instance 81b25262-b3d3-43a6-a674-7bd204e45e31 on hv-cinder-maste Jan 10 12:49:57.232425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-5cb84389-cacc-40f7-a4e5-9931602e4eb7 req-60f3da56-d02b-4431-8cfc-2b743db8eb1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066915 Jan 10 12:49:57.233702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 201/412] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:57.321851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:57.330502 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d8650734-b847-43ee-8c7a-d1b928623505 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.336624 Jan 10 12:49:57.340221 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 212/413] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:56 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:57.414212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:57.415305 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:57.427999 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.428466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.429275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.429707 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.607075 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:57.614518 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c725c01a-0203-41d3-847e-0344c93bdce7 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1516 microversion: 2.1 time: 0.205488 Jan 10 12:49:57.639805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 202/414] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:57 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:57.760441 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:57.761560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:57.769408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.774278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.778684 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.779461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.921298 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f71cdecf-4dc8-4204-ad0e-db6484507557 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:57.922549 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f71cdecf-4dc8-4204-ad0e-db6484507557 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:57.956235 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f71cdecf-4dc8-4204-ad0e-db6484507557 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.956937 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f71cdecf-4dc8-4204-ad0e-db6484507557 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:57.963294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f71cdecf-4dc8-4204-ad0e-db6484507557 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:57.966796 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f71cdecf-4dc8-4204-ad0e-db6484507557 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:58.167846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f71cdecf-4dc8-4204-ad0e-db6484507557 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 23129 microversion: 2.1 time: 0.250441 Jan 10 12:49:58.168494 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 203/415] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:57 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 23129 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:49:58.177809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:58.178727 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:58.179503 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:58.194468 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:58.196126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:58.197483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:58.198419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:58.201140 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:58.201837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:58.202860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5774b4bf-f1b5-4592-a40d-b7e3acbbb259 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1742 microversion: 2.20 time: 0.447826 Jan 10 12:49:58.207586 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 213/416] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:57 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1742 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:58.316491 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:58.326125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-20ad35d0-551c-49c1-9ad3-0ee5a1f09b1b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1271 microversion: 2.1 time: 0.155324 Jan 10 12:49:58.327204 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 204/417] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:58 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:58.347822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:58.348438 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:58.360628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:58.361144 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:58.364731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:58.365907 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:58.534866 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:58.544449 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fc2dfb62-2913-4a60-b69d-3bdd2ddf89c4 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.200210 Jan 10 12:49:58.545394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 214/418] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:58 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:59.183535 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d5c7e9de-b665-4626-81d9-d7cda91b181f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:59.185355 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d5c7e9de-b665-4626-81d9-d7cda91b181f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:59.207855 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5c7e9de-b665-4626-81d9-d7cda91b181f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.208096 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5c7e9de-b665-4626-81d9-d7cda91b181f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.209289 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5c7e9de-b665-4626-81d9-d7cda91b181f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.209937 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d5c7e9de-b665-4626-81d9-d7cda91b181f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.222188 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:59.222886 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:59.235145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.235739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.236797 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.237849 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.392977 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d5c7e9de-b665-4626-81d9-d7cda91b181f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 23432 microversion: 2.1 time: 0.216541 Jan 10 12:49:59.394392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 205/419] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:49:59 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 23432 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:49:59.400847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:59.401732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:59.409108 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.410287 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.411369 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.411992 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.567504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:59.568391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:59.578040 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fe0c6299-1300-4fb2-be7f-d028444e7f87 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1277 microversion: 2.1 time: 0.181791 Jan 10 12:49:59.579731 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 206/420] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:59 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:59.582646 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:59.584245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:59.585452 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7967e0d5-7a45-4702-bc36-86f43b080047 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.367187 Jan 10 12:49:59.588991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:59.589698 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:59.598500 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 215/421] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:49:59 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:49:59.599584 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.600644 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.603574 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.604717 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.609960 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-6df71c94-53db-4dfd-ab0b-1f64f50180f8 req-e50f495c-263d-4e1f-96f2-338b41e9bdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3436ba09-022f-4b36-987d-667c236d68d1", "name": "network-vif-plugged", "status": "completed", "tag": "0341fd05-df0a-4b20-a713-82457a146a1c"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:59.616617 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:49:59.616617 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:49:59.644934 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-6df71c94-53db-4dfd-ab0b-1f64f50180f8 req-e50f495c-263d-4e1f-96f2-338b41e9bdb9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.645445 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-6df71c94-53db-4dfd-ab0b-1f64f50180f8 req-e50f495c-263d-4e1f-96f2-338b41e9bdb9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.690018 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-6df71c94-53db-4dfd-ab0b-1f64f50180f8 req-e50f495c-263d-4e1f-96f2-338b41e9bdb9 service nova] Creating event network-vif-plugged:0341fd05-df0a-4b20-a713-82457a146a1c for instance 3436ba09-022f-4b36-987d-667c236d68d1 on hv-cinder-maste Jan 10 12:49:59.703980 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-6df71c94-53db-4dfd-ab0b-1f64f50180f8 req-e50f495c-263d-4e1f-96f2-338b41e9bdb9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103991 Jan 10 12:49:59.704600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 216/422] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:49:59.710362 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:49:59.716812 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:59.730339 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.735038 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.736444 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.744366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.839955 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:49:59.856219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fe172717-3cb9-41ad-b347-718771904bf3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1516 microversion: 2.1 time: 0.273040 Jan 10 12:49:59.856917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 207/423] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:59 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:49:59.876745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-06f3555c-0233-43c0-b1fe-3bb8636b06aa tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95771858-ecd9-4e3a-a99f-fc0a0247a5c6"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:49:59.879223 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-06f3555c-0233-43c0-b1fe-3bb8636b06aa tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:49:59.892030 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f3555c-0233-43c0-b1fe-3bb8636b06aa tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.892891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f3555c-0233-43c0-b1fe-3bb8636b06aa tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:49:59.893917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f3555c-0233-43c0-b1fe-3bb8636b06aa tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:49:59.894568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f3555c-0233-43c0-b1fe-3bb8636b06aa tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:00.066835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:00.085443 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-00f89df2-91cb-40a6-917d-fb826691364e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.379308 Jan 10 12:50:00.095875 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 217/424] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:49:59 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:00.423828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-06f3555c-0233-43c0-b1fe-3bb8636b06aa tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541572 Jan 10 12:50:00.423828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 208/425] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:49:59 2022] POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:50:00.501254 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7000d4df-57c9-4920-b32e-c804af7222e7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:00.502639 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7000d4df-57c9-4920-b32e-c804af7222e7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:00.515589 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7000d4df-57c9-4920-b32e-c804af7222e7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:00.517775 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7000d4df-57c9-4920-b32e-c804af7222e7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:00.518895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7000d4df-57c9-4920-b32e-c804af7222e7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:00.522645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7000d4df-57c9-4920-b32e-c804af7222e7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:00.598064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:00.598777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:00.630949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:00.631413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:00.632249 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:00.638189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:00.700095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7000d4df-57c9-4920-b32e-c804af7222e7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 24486 microversion: 2.1 time: 0.275361 Jan 10 12:50:00.700245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 218/426] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:00 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 24486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:00.710133 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:00.711215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:00.741162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:00.741843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:00.742947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:00.743590 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:01.224268 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:01.230071 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:01.239179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bfa29dde-b589-43f9-9ec9-c99d97269fd1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.645965 Jan 10 12:50:01.242470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:01.243054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 209/427] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:00 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:01.247615 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:01.257065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8d8a09dd-0190-4654-b684-0fb4eeb61894 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.555565 Jan 10 12:50:01.259470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 219/428] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:00 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:01.264059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:01.264677 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:01.286005 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:01.286875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:01.292483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:01.292941 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:01.552481 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:01.567166 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-456fa9da-0f0a-4041-8fb4-b596a634717c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.322706 Jan 10 12:50:01.568273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 210/429] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:01 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:01.717082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1912d626-a0c1-4cf4-9c55-2a0a05be8f5b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:01.719077 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1912d626-a0c1-4cf4-9c55-2a0a05be8f5b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:01.739552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1912d626-a0c1-4cf4-9c55-2a0a05be8f5b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:01.741558 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1912d626-a0c1-4cf4-9c55-2a0a05be8f5b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:01.749330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1912d626-a0c1-4cf4-9c55-2a0a05be8f5b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:01.750036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1912d626-a0c1-4cf4-9c55-2a0a05be8f5b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:01.879011 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1912d626-a0c1-4cf4-9c55-2a0a05be8f5b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 25314 microversion: 2.1 time: 0.170815 Jan 10 12:50:01.886387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 220/430] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:01 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 25314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:02.259368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:02.260299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:02.277980 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:02.278699 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:02.289232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.291411 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.295875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.296615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.331793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.332332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.339812 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.340270 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.601515 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:02.637981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-06f436b0-3282-48ea-b214-599d9bb1f98a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.383571 Jan 10 12:50:02.665869 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 211/431] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:02 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:02.695106 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-ef5ab237-76e3-40e3-bfd2-7ed8ffff8387 req-2b2e8596-fa6b-4fd8-aa08-9107b6f08229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a3b001-2e2d-41ff-b973-ba9c612f2e57", "tag": "f8161287-bb70-4b66-8b85-92c2fa1f8702"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:02.697664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:02.703503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:02.703503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:02.719699 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:02.725468 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:02.730310 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-684b713c-355d-4686-8d80-f3a08b8216fd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.456289 Jan 10 12:50:02.741467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 221/432] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:02 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:02.741467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:02.741467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:02.750548 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-ef5ab237-76e3-40e3-bfd2-7ed8ffff8387 req-2b2e8596-fa6b-4fd8-aa08-9107b6f08229 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.752021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-ef5ab237-76e3-40e3-bfd2-7ed8ffff8387 req-2b2e8596-fa6b-4fd8-aa08-9107b6f08229 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.768123 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.768830 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.777822 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-ef5ab237-76e3-40e3-bfd2-7ed8ffff8387 req-2b2e8596-fa6b-4fd8-aa08-9107b6f08229 service nova] Creating event network-changed:f8161287-bb70-4b66-8b85-92c2fa1f8702 for instance 72a3b001-2e2d-41ff-b973-ba9c612f2e57 on hv-cinder-maste Jan 10 12:50:02.780306 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.783249 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.787962 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-ef5ab237-76e3-40e3-bfd2-7ed8ffff8387 req-2b2e8596-fa6b-4fd8-aa08-9107b6f08229 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118005 Jan 10 12:50:02.789898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 212/433] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:02.895584 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-99d167c2-8b0d-49ab-aa26-f71bebe6e6f3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:02.897755 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-99d167c2-8b0d-49ab-aa26-f71bebe6e6f3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:02.919151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99d167c2-8b0d-49ab-aa26-f71bebe6e6f3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.921635 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99d167c2-8b0d-49ab-aa26-f71bebe6e6f3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:02.925533 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99d167c2-8b0d-49ab-aa26-f71bebe6e6f3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:02.928614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99d167c2-8b0d-49ab-aa26-f71bebe6e6f3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:03.073203 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-99d167c2-8b0d-49ab-aa26-f71bebe6e6f3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 26223 microversion: 2.1 time: 0.183631 Jan 10 12:50:03.073752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 213/434] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:02 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 26223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:03.114009 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:03.123245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bde4ff43-efbf-4bf9-8889-e779d8b63d48 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.391196 Jan 10 12:50:03.123869 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 222/435] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:02 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:03.673899 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:03.675242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:03.693943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:03.695446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:03.697165 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:03.697886 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:03.750819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:03.751468 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:03.803130 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:03.807914 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:03.808907 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:03.810257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:04.157747 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:04.165711 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a438d14f-28a4-438b-8938-77d163e60247 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.496209 Jan 10 12:50:04.173181 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 214/436] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:03 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:04.178291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2512ea92-c22a-43c3-b6c2-7c8f8335c8e8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:04.179232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2512ea92-c22a-43c3-b6c2-7c8f8335c8e8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:04.192370 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2512ea92-c22a-43c3-b6c2-7c8f8335c8e8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:04.192811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2512ea92-c22a-43c3-b6c2-7c8f8335c8e8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:04.193617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2512ea92-c22a-43c3-b6c2-7c8f8335c8e8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:04.194051 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2512ea92-c22a-43c3-b6c2-7c8f8335c8e8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:04.209186 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:04.224828 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:04.226641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:04.228203 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6a0bb9ed-a641-44b7-b89e-928ecb0b2d55 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.481171 Jan 10 12:50:04.245672 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 223/437] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:03 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:04.250661 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:04.251488 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:04.264178 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:04.272243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:04.273324 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:04.274098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:04.360686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2512ea92-c22a-43c3-b6c2-7c8f8335c8e8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 26928 microversion: 2.1 time: 0.185851 Jan 10 12:50:04.364086 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 215/438] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:04 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 26928 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:04.676958 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:04.685086 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-dc9616dd-ee99-40e9-b46d-0f0dd491a728 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.437654 Jan 10 12:50:04.685708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 224/439] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:04 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:05.204637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:05.216997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:05.251594 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:05.252963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:05.260120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.261288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.266022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.266600 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.270114 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.270569 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.271370 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.271844 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.543215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:05.557044 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:05.559234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:05.562835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-90465773-baa5-4485-86ff-9620f49b5f03 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.317916 Jan 10 12:50:05.565325 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 225/440] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:05 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:05.594624 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8c562f40-9f3c-45f8-aa3a-af1827c87d3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:05.601387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8c562f40-9f3c-45f8-aa3a-af1827c87d3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:05.625326 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c562f40-9f3c-45f8-aa3a-af1827c87d3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.628424 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c562f40-9f3c-45f8-aa3a-af1827c87d3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.632885 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:05.634399 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c562f40-9f3c-45f8-aa3a-af1827c87d3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.636343 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c562f40-9f3c-45f8-aa3a-af1827c87d3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.652506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1d7f770f-0347-403c-a80a-2072da1526ac tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.453147 Jan 10 12:50:05.653356 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 216/441] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:05 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:05.657995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-3032a865-19bf-4a26-a156-e5de0fbc2f1b req-61175ad6-279d-494f-924a-e3e46197b1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b25262-b3d3-43a6-a674-7bd204e45e31", "name": "network-vif-plugged", "status": "completed", "tag": "d7de2099-ce7e-43d9-9a27-d9371be7127a"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:05.659833 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:05.659833 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:05.677498 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-3032a865-19bf-4a26-a156-e5de0fbc2f1b req-61175ad6-279d-494f-924a-e3e46197b1e9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.692289 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-3032a865-19bf-4a26-a156-e5de0fbc2f1b req-61175ad6-279d-494f-924a-e3e46197b1e9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.713291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-3032a865-19bf-4a26-a156-e5de0fbc2f1b req-61175ad6-279d-494f-924a-e3e46197b1e9 service nova] Creating event network-vif-plugged:d7de2099-ce7e-43d9-9a27-d9371be7127a for instance 81b25262-b3d3-43a6-a674-7bd204e45e31 on hv-cinder-maste Jan 10 12:50:05.726141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-3032a865-19bf-4a26-a156-e5de0fbc2f1b req-61175ad6-279d-494f-924a-e3e46197b1e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070931 Jan 10 12:50:05.727457 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 217/442] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:05.739242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:05.746075 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:05.783053 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.783730 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.786058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:05.787759 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:05.800547 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8c562f40-9f3c-45f8-aa3a-af1827c87d3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 27486 microversion: 2.1 time: 0.222225 Jan 10 12:50:05.801602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 226/443] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:05 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 27486 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:06.114742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:06.138745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c1fdf949-3ba0-4a53-ab88-ee602bb0e860 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.409566 Jan 10 12:50:06.141111 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 218/444] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:05 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:06.586426 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:06.588062 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:06.598894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:06.599617 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:06.600933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:06.601516 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:06.668743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:06.670148 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:06.676584 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:06.679175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:06.686580 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:06.687403 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:06.893167 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:06.903252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:06.912087 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:06.913519 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d2514315-4e42-4c24-bb77-74366e21b32b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.334670 Jan 10 12:50:06.914503 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 227/445] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:06 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:06.926897 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-32aaf3ba-5989-4a68-8b9b-4aae05f35b1b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:06.928234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-32aaf3ba-5989-4a68-8b9b-4aae05f35b1b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:06.940551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32aaf3ba-5989-4a68-8b9b-4aae05f35b1b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:06.941376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32aaf3ba-5989-4a68-8b9b-4aae05f35b1b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:06.942367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32aaf3ba-5989-4a68-8b9b-4aae05f35b1b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:06.943351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-32aaf3ba-5989-4a68-8b9b-4aae05f35b1b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:06.995712 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:07.008903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-47f5bc8f-e1e1-4762-b253-552a9e65b5e2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.343294 Jan 10 12:50:07.011577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 219/446] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:06 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:07.085893 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-32aaf3ba-5989-4a68-8b9b-4aae05f35b1b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 27726 microversion: 2.1 time: 0.169025 Jan 10 12:50:07.087266 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 228/447] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:06 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 27726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:07.160531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:07.162263 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:07.169497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:07.170205 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:07.171171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:07.171800 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:07.483712 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:07.507217 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cb8b5482-b1e7-46dd-a2b9-024cb2d30481 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1317 microversion: 2.1 time: 0.353379 Jan 10 12:50:07.508240 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 220/448] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:07 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:07.941641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:07.947049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:07.981978 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:07.988538 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:07.989968 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:07.991216 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.027640 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:08.031197 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:08.053220 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.063554 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.067434 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.070666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.468246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:08.500341 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:08.531006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2b921c94-dd2d-4b17-a843-178eca15bd56 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.507667 Jan 10 12:50:08.533218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:08.535348 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:08.536531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 221/449] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:08 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:08.539304 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4540e798-bec5-4d6e-bbae-e9ba0c9d6cb1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.610380 Jan 10 12:50:08.546716 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 229/450] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:07 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:08.551344 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-22981151-ed3d-4f89-973d-825e8ca5a31a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:08.560859 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-22981151-ed3d-4f89-973d-825e8ca5a31a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:08.565357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:08.569387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:08.590639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22981151-ed3d-4f89-973d-825e8ca5a31a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.592999 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22981151-ed3d-4f89-973d-825e8ca5a31a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.594042 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22981151-ed3d-4f89-973d-825e8ca5a31a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.605727 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22981151-ed3d-4f89-973d-825e8ca5a31a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.612069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.612529 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.616147 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.617040 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.790365 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-22981151-ed3d-4f89-973d-825e8ca5a31a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28156 microversion: 2.1 time: 0.252166 Jan 10 12:50:08.791454 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 222/451] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:08 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28156 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:08.799744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:08.801047 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:08.826197 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.833947 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.835170 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:08.840310 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:08.921634 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lazy-loading 'flavor' on Instance uuid e102ed1c-55c4-488a-9729-a99f58666989 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:50:08.971076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:08.984140 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c48f238f-ed77-41ce-a7bc-26db58cd726a tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1506 microversion: 2.1 time: 0.429781 Jan 10 12:50:08.985053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 230/452] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:08 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:09.259959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-55f18a7e-3ec4-4ef0-8989-f5a36e58b3dd tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action" status: 200 len: 32 microversion: 2.1 time: 0.466761 Jan 10 12:50:09.261438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 223/453] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:08 2022] POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:50:09.275136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:09.278997 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:09.304782 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:09.306770 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:09.310787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:09.313046 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:09.558544 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:09.559577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:09.574008 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:09.575806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:09.578692 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:09.579407 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:10.302151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:10.315491 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-369ead69-77ce-4c9a-a6b7-9eb12f1419f3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.765235 Jan 10 12:50:10.318917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 224/454] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:09 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:10.329297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:10.332234 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:10.346708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:10.347543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:10.349777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:10.353432 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:10.479746 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:10.509310 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-688805f9-9322-48dc-89da-5ca4a8a6ab9f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 1.238985 Jan 10 12:50:10.511876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 231/455] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:09 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:10.520766 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-36b063b9-7428-487d-8767-8851218e2d27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:10.522086 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-36b063b9-7428-487d-8767-8851218e2d27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:10.536363 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36b063b9-7428-487d-8767-8851218e2d27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:10.537933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36b063b9-7428-487d-8767-8851218e2d27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:10.539788 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36b063b9-7428-487d-8767-8851218e2d27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:10.540475 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36b063b9-7428-487d-8767-8851218e2d27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:10.654027 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-36b063b9-7428-487d-8767-8851218e2d27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28156 microversion: 2.1 time: 0.139823 Jan 10 12:50:10.654812 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 232/456] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:10 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28156 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:10.665553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1a2b5e63-469a-43b3-abd8-4a64a6391b7e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62abe5fd-0ca5-4386-983d-80dff8788d6e"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:10.675282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1a2b5e63-469a-43b3-abd8-4a64a6391b7e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:10.693695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a2b5e63-469a-43b3-abd8-4a64a6391b7e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:10.698774 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a2b5e63-469a-43b3-abd8-4a64a6391b7e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:10.702205 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a2b5e63-469a-43b3-abd8-4a64a6391b7e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:10.702855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a2b5e63-469a-43b3-abd8-4a64a6391b7e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:10.777386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:10.789127 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:10.794378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:10.800599 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4a802bb4-5d16-4b93-8eee-8d98063c03b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.477287 Jan 10 12:50:10.801682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 225/457] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:10 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:11.105211 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1a2b5e63-469a-43b3-abd8-4a64a6391b7e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "POST /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444874 Jan 10 12:50:11.106764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 233/458] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:50:10 2022] POST /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:11.334243 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:11.334869 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:11.346991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:11.347443 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:11.351297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:11.351850 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:11.527346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:11.528120 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:11.545383 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:11.545867 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:11.546701 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:11.547147 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:11.755232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:11.768034 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ba4cc3f0-5b9a-4e35-8f91-a32191a77bce tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.437207 Jan 10 12:50:11.770781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 226/459] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:11 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:11.779509 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-abf2b976-7de5-4290-844b-f7ca307ec6cc req-feebfabe-6a44-4c88-ba68-9196e525f905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a3b001-2e2d-41ff-b973-ba9c612f2e57", "name": "network-vif-plugged", "status": "completed", "tag": "f8161287-bb70-4b66-8b85-92c2fa1f8702"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:11.781409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:11.781409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:11.800144 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-abf2b976-7de5-4290-844b-f7ca307ec6cc req-feebfabe-6a44-4c88-ba68-9196e525f905 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:11.805467 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-abf2b976-7de5-4290-844b-f7ca307ec6cc req-feebfabe-6a44-4c88-ba68-9196e525f905 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:11.833900 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-abf2b976-7de5-4290-844b-f7ca307ec6cc req-feebfabe-6a44-4c88-ba68-9196e525f905 service nova] Creating event network-vif-plugged:f8161287-bb70-4b66-8b85-92c2fa1f8702 for instance 72a3b001-2e2d-41ff-b973-ba9c612f2e57 on hv-cinder-maste Jan 10 12:50:11.844472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-abf2b976-7de5-4290-844b-f7ca307ec6cc req-feebfabe-6a44-4c88-ba68-9196e525f905 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071795 Jan 10 12:50:11.845279 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 227/460] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:11.861054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a148f029-0dd2-459d-8194-dfae295a5328 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:11.862064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a148f029-0dd2-459d-8194-dfae295a5328 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:11.877809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a148f029-0dd2-459d-8194-dfae295a5328 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:11.878722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a148f029-0dd2-459d-8194-dfae295a5328 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:11.879141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a148f029-0dd2-459d-8194-dfae295a5328 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:11.879594 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a148f029-0dd2-459d-8194-dfae295a5328 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:11.996867 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a148f029-0dd2-459d-8194-dfae295a5328 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28445 microversion: 2.1 time: 0.139668 Jan 10 12:50:11.997538 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 228/461] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:11 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:12.016160 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:12.020717 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:12.054964 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:12.055823 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:12.058932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:12.060567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:12.327020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:12.339127 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2045b32e-f002-424e-ae0b-e0daee5cab63 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.813146 Jan 10 12:50:12.341677 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 234/462] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:11 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:12.423691 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:12.439406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:12.441153 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:12.442385 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a98a8909-31fc-400b-9c2d-f63c085cbbca tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.443586 Jan 10 12:50:12.444771 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 229/463] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:11 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:12.785083 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:12.786436 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:12.797949 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:12.800078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:12.801302 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:12.801749 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:13.009138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2d05ec76-c605-4da6-8f61-556b9d970b25 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:13.012446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2d05ec76-c605-4da6-8f61-556b9d970b25 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:13.031664 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2d05ec76-c605-4da6-8f61-556b9d970b25 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:13.032285 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2d05ec76-c605-4da6-8f61-556b9d970b25 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:13.033118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2d05ec76-c605-4da6-8f61-556b9d970b25 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:13.037518 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2d05ec76-c605-4da6-8f61-556b9d970b25 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:13.183129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2d05ec76-c605-4da6-8f61-556b9d970b25 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28463 microversion: 2.1 time: 0.177116 Jan 10 12:50:13.184319 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 230/464] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:13 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28463 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:13.287329 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:13.295438 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-42390749-2a59-44b8-ab2f-a62b284dc15c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1319 microversion: 2.1 time: 0.514219 Jan 10 12:50:13.296057 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 235/465] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:12 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:13.360993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:13.367477 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:13.385542 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:13.387291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:13.389565 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:13.390020 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:13.462728 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:13.463480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:13.474924 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:13.478214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:13.480510 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:13.484154 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:13.987560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:13.991397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:14.003385 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ad3a0d02-2d66-445e-aefe-84263215efa5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.648883 Jan 10 12:50:14.004448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:14.006852 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:14.008677 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 231/466] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:13 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:14.009684 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d85a5ba0-95a1-4d70-8062-6db1e1486de7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.551418 Jan 10 12:50:14.010534 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 236/467] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:13 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:14.197081 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6d4fe1f9-d233-4d7a-ab8e-a02e9777a444 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:14.201482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6d4fe1f9-d233-4d7a-ab8e-a02e9777a444 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:14.214395 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d4fe1f9-d233-4d7a-ab8e-a02e9777a444 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:14.219222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d4fe1f9-d233-4d7a-ab8e-a02e9777a444 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:14.220193 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d4fe1f9-d233-4d7a-ab8e-a02e9777a444 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:14.220641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d4fe1f9-d233-4d7a-ab8e-a02e9777a444 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:14.321756 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:14.328636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:14.340641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:14.341401 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:14.342882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:14.343687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:14.380673 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6d4fe1f9-d233-4d7a-ab8e-a02e9777a444 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28613 microversion: 2.1 time: 0.187516 Jan 10 12:50:14.387849 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 232/468] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:14 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28613 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:14.584339 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:14.592807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e5755ddb-cd65-435e-99ad-9b72e1d4e22a tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1509 microversion: 2.1 time: 0.283584 Jan 10 12:50:14.604551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 237/469] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:14 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:15.030132 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:15.031678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:15.032363 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:15.036611 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:15.061745 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:15.064073 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:15.068527 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:15.071730 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:15.072637 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:15.073207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:15.080307 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:15.081404 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:15.504150 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:15.505680 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:15.513884 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:15.514909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b0bae1fd-8d84-4b2d-ad41-f698252a5c2c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.496902 Jan 10 12:50:15.515504 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 233/470] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:15 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:15.520397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-46d3ab0b-b0f7-4ca0-aba2-50d4c6c345d6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:15.521486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-46d3ab0b-b0f7-4ca0-aba2-50d4c6c345d6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:15.526716 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:15.530781 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5cee3984-56fa-4524-9d1b-82785fd6077e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.505364 Jan 10 12:50:15.531072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-46d3ab0b-b0f7-4ca0-aba2-50d4c6c345d6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:15.531795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 238/471] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:15 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:15.543317 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-46d3ab0b-b0f7-4ca0-aba2-50d4c6c345d6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:15.544869 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-46d3ab0b-b0f7-4ca0-aba2-50d4c6c345d6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:15.545604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-46d3ab0b-b0f7-4ca0-aba2-50d4c6c345d6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:15.640968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-46d3ab0b-b0f7-4ca0-aba2-50d4c6c345d6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28613 microversion: 2.1 time: 0.123762 Jan 10 12:50:15.642362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 234/472] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:15 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:16.532065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:16.533291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:16.546278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:16.547098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:16.548509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:16.549140 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:16.582104 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:16.583470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:16.598431 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:16.599249 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:16.600420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:16.601325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:16.992824 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:16.996740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:17.005737 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-dde9cd51-f2e6-42b7-a350-3e358df55f90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.477206 Jan 10 12:50:17.010245 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:17.020122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 239/473] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:16 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:17.020122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-279862ce-fca8-447b-85f9-bec766047e9f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:17.020122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-279862ce-fca8-447b-85f9-bec766047e9f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:17.022575 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:17.026292 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-853bc865-8874-43c6-a910-8ec1c0883d77 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.468444 Jan 10 12:50:17.028520 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 235/474] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:16 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:17.037255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-279862ce-fca8-447b-85f9-bec766047e9f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:17.037832 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-279862ce-fca8-447b-85f9-bec766047e9f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:17.038714 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-279862ce-fca8-447b-85f9-bec766047e9f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:17.039524 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-279862ce-fca8-447b-85f9-bec766047e9f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:17.159998 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-279862ce-fca8-447b-85f9-bec766047e9f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28613 microversion: 2.1 time: 0.147200 Jan 10 12:50:17.161701 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 240/475] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:17 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28613 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:18.030885 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:18.032701 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:18.041037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:18.047149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:18.048423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:18.052180 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:18.053047 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:18.053510 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:18.060411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:18.063025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:18.064604 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:18.066154 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:18.628922 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:18.638379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e89e937d-6ad9-4018-8296-6e4ba0401411 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.612843 Jan 10 12:50:18.643442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 236/476] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:18 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:18.648614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-921ad2a2-e5e3-4b0d-aff1-15d428880be3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:18.649900 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-921ad2a2-e5e3-4b0d-aff1-15d428880be3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:18.656787 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-921ad2a2-e5e3-4b0d-aff1-15d428880be3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:18.657524 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-921ad2a2-e5e3-4b0d-aff1-15d428880be3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:18.658501 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-921ad2a2-e5e3-4b0d-aff1-15d428880be3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:18.659209 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-921ad2a2-e5e3-4b0d-aff1-15d428880be3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:18.683244 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:18.692826 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:18.700096 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:18.701671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a2a606c8-4b73-4048-bf52-152de452fb62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1737 microversion: 2.20 time: 0.659112 Jan 10 12:50:18.702600 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 241/477] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:18 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1737 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:18.749792 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-921ad2a2-e5e3-4b0d-aff1-15d428880be3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28613 microversion: 2.1 time: 0.104401 Jan 10 12:50:18.754376 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 237/478] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:18 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28613 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:19.220227 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:19.220875 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:19.228293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.228860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:19.229733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.232584 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:19.378608 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lazy-loading 'services' on Instance uuid 81b25262-b3d3-43a6-a674-7bd204e45e31 {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:50:19.486281 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ceec6fbe-8dcd-4340-8275-dde140566e65 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments/62abe5fd-0ca5-4386-983d-80dff8788d6e" status: 202 len: 0 microversion: 2.1 time: 0.269795 Jan 10 12:50:19.486889 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 242/479] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:50:19 2022] DELETE /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments/62abe5fd-0ca5-4386-983d-80dff8788d6e => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:50:19.496325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-55cae396-9402-4e99-bcca-2982a0ae9323 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:19.498071 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-55cae396-9402-4e99-bcca-2982a0ae9323 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:19.515770 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55cae396-9402-4e99-bcca-2982a0ae9323 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.516641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55cae396-9402-4e99-bcca-2982a0ae9323 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:19.517748 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55cae396-9402-4e99-bcca-2982a0ae9323 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.518969 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-55cae396-9402-4e99-bcca-2982a0ae9323 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:19.598634 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-55cae396-9402-4e99-bcca-2982a0ae9323 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107052 Jan 10 12:50:19.606651 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 238/480] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:19 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:19.661198 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:19.662273 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:19.681358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.682241 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:19.683191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.685042 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:19.720720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:19.721389 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:19.736334 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.736791 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:19.737599 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:19.738037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:20.033471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:20.040317 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:20.044296 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6bf01377-db20-4f14-ad16-bc3816538a3a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.392069 Jan 10 12:50:20.055079 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 243/481] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:19 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:20.055214 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:20.057359 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:20.061031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-830a5d0a-9786-45bd-abd1-022e867e6cf3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:20.061867 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d68233df-b2f8-499c-abfe-1bb5d7ca67fe tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1719 microversion: 2.20 time: 0.342298 Jan 10 12:50:20.062553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-830a5d0a-9786-45bd-abd1-022e867e6cf3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:20.063096 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 239/482] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:19 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1719 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:20.071773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-830a5d0a-9786-45bd-abd1-022e867e6cf3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:20.072591 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-830a5d0a-9786-45bd-abd1-022e867e6cf3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:20.073640 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-830a5d0a-9786-45bd-abd1-022e867e6cf3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:20.074077 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-830a5d0a-9786-45bd-abd1-022e867e6cf3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:20.167894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-830a5d0a-9786-45bd-abd1-022e867e6cf3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 28613 microversion: 2.1 time: 0.110824 Jan 10 12:50:20.172625 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 244/483] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:20 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 28613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:20.612118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-553d2bfc-cad1-4556-b1c9-db92e89df06b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:20.613097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-553d2bfc-cad1-4556-b1c9-db92e89df06b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:20.623629 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-553d2bfc-cad1-4556-b1c9-db92e89df06b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:20.624091 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-553d2bfc-cad1-4556-b1c9-db92e89df06b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:20.625492 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-553d2bfc-cad1-4556-b1c9-db92e89df06b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:20.625935 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-553d2bfc-cad1-4556-b1c9-db92e89df06b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:20.675756 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-553d2bfc-cad1-4556-b1c9-db92e89df06b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067435 Jan 10 12:50:20.676812 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 240/484] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:20 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:21.073363 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:21.074165 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:21.079802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:21.081117 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:21.082390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.082839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.083727 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.084175 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.089358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.090237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.091785 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.098903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.344877 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:21.349007 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:21.354058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:21.355787 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:21.357033 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7d8ed878-fd53-4df3-973f-565fd04a3372 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1719 microversion: 2.20 time: 0.280927 Jan 10 12:50:21.357238 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-170c6857-2922-4da6-99d9-9fb0bbbf4f9e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.299263 Jan 10 12:50:21.357599 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 241/485] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:21 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1719 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:21.357983 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 245/486] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:21 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:21.362830 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9011d510-3825-48b4-ba0f-7616c0cfd9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:21.364231 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9011d510-3825-48b4-ba0f-7616c0cfd9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:21.370911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9011d510-3825-48b4-ba0f-7616c0cfd9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.371446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9011d510-3825-48b4-ba0f-7616c0cfd9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.372350 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9011d510-3825-48b4-ba0f-7616c0cfd9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.372859 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9011d510-3825-48b4-ba0f-7616c0cfd9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.473462 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9011d510-3825-48b4-ba0f-7616c0cfd9fc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 29159 microversion: 2.1 time: 0.114044 Jan 10 12:50:21.474358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 242/487] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:21 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 29159 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:21.577785 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4e824bb0-c89a-401c-90fb-afa7c1657f19 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Action: 'create', calling method: .version_select at 0x7f7fca7a5dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-174268589"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:21.592224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4e824bb0-c89a-401c-90fb-afa7c1657f19 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:50:21.596093 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4e824bb0-c89a-401c-90fb-afa7c1657f19 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for user ffd65d5f1d484d48a3ed84cf1592956c and project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:50:21.688623 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-704a159d-9a2d-4641-9880-a1682ce4baae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:21.689673 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-704a159d-9a2d-4641-9880-a1682ce4baae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:21.697120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-704a159d-9a2d-4641-9880-a1682ce4baae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.697572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-704a159d-9a2d-4641-9880-a1682ce4baae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.698356 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-704a159d-9a2d-4641-9880-a1682ce4baae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:21.698825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-704a159d-9a2d-4641-9880-a1682ce4baae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:21.722841 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4e824bb0-c89a-401c-90fb-afa7c1657f19 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:50:21.726619 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-4e824bb0-c89a-401c-90fb-afa7c1657f19 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for user ffd65d5f1d484d48a3ed84cf1592956c and project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:50:21.729567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-704a159d-9a2d-4641-9880-a1682ce4baae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045462 Jan 10 12:50:21.730137 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 243/488] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:21 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:50:21.744592 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4e824bb0-c89a-401c-90fb-afa7c1657f19 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.353182 Jan 10 12:50:21.745390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 246/489] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Jan 10 12:50:21 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:22.376304 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:22.377373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:22.384504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:22.386278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:22.389225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.390943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:22.391892 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.392431 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:22.395083 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.396391 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:22.397698 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.398131 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:22.903008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:22.919636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:22.925775 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:22.929726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7a5f51ae-fe8e-42cf-a311-ca14d10b1ae6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.557980 Jan 10 12:50:22.930899 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 244/490] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:22 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:22.931449 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:22.936271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f9a2fb4b-bf00-4b6d-ad9d-09bb8c9d7c16 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1722 microversion: 2.20 time: 0.560593 Jan 10 12:50:22.936826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-623ce61a-a34a-4e3b-914f-85315c86caac tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:22.937513 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 247/491] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:22 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1722 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:22.938183 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-623ce61a-a34a-4e3b-914f-85315c86caac tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:22.947984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-623ce61a-a34a-4e3b-914f-85315c86caac tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.948675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-623ce61a-a34a-4e3b-914f-85315c86caac tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:22.949630 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-623ce61a-a34a-4e3b-914f-85315c86caac tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.950615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-623ce61a-a34a-4e3b-914f-85315c86caac tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:22.958865 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-37dc99af-fd31-40ee-a129-48de44d5c1c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14f2bcac-84eb-4e09-b5bf-6713e45632b8"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:22.960331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-37dc99af-fd31-40ee-a129-48de44d5c1c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:22.972905 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37dc99af-fd31-40ee-a129-48de44d5c1c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.974765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37dc99af-fd31-40ee-a129-48de44d5c1c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:22.976998 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37dc99af-fd31-40ee-a129-48de44d5c1c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:22.977452 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37dc99af-fd31-40ee-a129-48de44d5c1c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.214215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-623ce61a-a34a-4e3b-914f-85315c86caac tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 30550 microversion: 2.1 time: 0.281385 Jan 10 12:50:23.215036 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 245/492] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:22 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 30550 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:23.222530 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:23.225635 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:23.233850 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.234595 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.235588 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.236740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.274805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Going to try to terminate instance {{(pid=123137) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:50:23.377137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-37dc99af-fd31-40ee-a129-48de44d5c1c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.422214 Jan 10 12:50:23.379743 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 248/493] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jan 10 12:50:22 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments => generated 188 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:23.401394 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-dd525459-0765-4a37-b367-8d6ded740eb1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 204 len: 0 microversion: 2.1 time: 0.183487 Jan 10 12:50:23.406229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 246/494] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:50:23 2022] DELETE /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:50:23.416180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:23.418144 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:23.428991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.429809 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.430684 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.434117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.504467 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-264076c6-7b4b-40b0-883f-bf96cfe4e38d req-71733bda-48e1-4a33-b10e-df8ada5cf48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3436ba09-022f-4b36-987d-667c236d68d1", "name": "network-vif-unplugged", "status": "completed", "tag": "0341fd05-df0a-4b20-a713-82457a146a1c"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:23.506301 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:23.506301 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:23.546064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-264076c6-7b4b-40b0-883f-bf96cfe4e38d req-71733bda-48e1-4a33-b10e-df8ada5cf48a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.546064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-264076c6-7b4b-40b0-883f-bf96cfe4e38d req-71733bda-48e1-4a33-b10e-df8ada5cf48a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.564577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.compute.server_external_events [req-264076c6-7b4b-40b0-883f-bf96cfe4e38d req-71733bda-48e1-4a33-b10e-df8ada5cf48a service nova] Unable to find a host for instance 3436ba09-022f-4b36-987d-667c236d68d1. Dropping event network-vif-unplugged {{(pid=123137) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 10 12:50:23.565696 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-264076c6-7b4b-40b0-883f-bf96cfe4e38d req-71733bda-48e1-4a33-b10e-df8ada5cf48a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066343 Jan 10 12:50:23.566929 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 247/495] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 10 12:50:23.573342 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b9ba030e-c19f-46dc-a09f-bffc016bfd15 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:23.574611 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b9ba030e-c19f-46dc-a09f-bffc016bfd15 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:23.582923 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b9ba030e-c19f-46dc-a09f-bffc016bfd15 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.583456 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b9ba030e-c19f-46dc-a09f-bffc016bfd15 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.584430 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b9ba030e-c19f-46dc-a09f-bffc016bfd15 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.584930 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b9ba030e-c19f-46dc-a09f-bffc016bfd15 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.617636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:23.626922 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-142d22b9-3b25-4141-981a-6da4faf6cfd0 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1512 microversion: 2.1 time: 0.219894 Jan 10 12:50:23.627891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 249/496] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:23 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:23.707034 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b9ba030e-c19f-46dc-a09f-bffc016bfd15 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action" status: 202 len: 0 microversion: 2.20 time: 0.138540 Jan 10 12:50:23.708155 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 248/497] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:50:23 2022] POST /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:50:23.716332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:23.716942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:23.730892 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.731848 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.733359 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.734002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.956542 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:23.957794 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:23.973564 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.976013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:23.982715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:23.983407 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:24.028940 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:24.048046 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:24.049757 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:24.051228 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-63aa8d39-7fd1-4914-b879-2fbdf644d889 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1748 microversion: 2.20 time: 0.338864 Jan 10 12:50:24.051854 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 250/498] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:23 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1748 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:24.226900 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1d1d34c1-b3db-4eaf-917a-dd5987c88e6b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:24.227507 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1d1d34c1-b3db-4eaf-917a-dd5987c88e6b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:24.243639 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d1d34c1-b3db-4eaf-917a-dd5987c88e6b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:24.244097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d1d34c1-b3db-4eaf-917a-dd5987c88e6b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:24.244914 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d1d34c1-b3db-4eaf-917a-dd5987c88e6b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:24.245332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1d1d34c1-b3db-4eaf-917a-dd5987c88e6b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:24.246013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:24.259309 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fcb80fe9-7e0b-466e-8455-b6ec72ac0b90 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.314968 Jan 10 12:50:24.268706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 249/499] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:23 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:24.338394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1d1d34c1-b3db-4eaf-917a-dd5987c88e6b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 31608 microversion: 2.1 time: 0.115569 Jan 10 12:50:24.339243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 251/500] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:24 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 31608 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:50:24.645552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:24.646060 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:24.656023 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:24.656657 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:24.657465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:24.658086 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:24.838397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:24.851734 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-30fbb1ee-e2cb-495f-8216-553bff4a1694 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1512 microversion: 2.1 time: 0.210538 Jan 10 12:50:24.853222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 250/501] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:24 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:25.071774 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:25.072884 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:25.081074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.081879 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:25.083225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.084087 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:25.239390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:25.248806 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:25.250320 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:25.251496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-df7a773b-cf8f-4726-b7f8-9679c79add32 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1750 microversion: 2.20 time: 0.184412 Jan 10 12:50:25.252088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 252/502] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:25 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:25.275506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:25.276426 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:25.285572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.286212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:25.287210 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.287670 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:25.350900 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-53f0bdfe-3ea8-4835-be7c-4882916852b6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:25.352010 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-53f0bdfe-3ea8-4835-be7c-4882916852b6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:25.360413 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53f0bdfe-3ea8-4835-be7c-4882916852b6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.361238 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53f0bdfe-3ea8-4835-be7c-4882916852b6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:25.362642 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53f0bdfe-3ea8-4835-be7c-4882916852b6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.363298 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53f0bdfe-3ea8-4835-be7c-4882916852b6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:25.430459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:25.440406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ce92003b-c981-42fa-9d19-99142f2a52ee tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.168822 Jan 10 12:50:25.441005 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 251/503] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:25 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:25.464899 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-53f0bdfe-3ea8-4835-be7c-4882916852b6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 32457 microversion: 2.1 time: 0.118026 Jan 10 12:50:25.469018 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 253/504] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:25 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 32457 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:25.870802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:25.871408 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:25.889590 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.890435 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:25.891583 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:25.892179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.054652 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:26.063577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d6af4a8c-7a4e-4780-9f7c-20bcd74c5fb2 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 200 len: 1512 microversion: 2.1 time: 0.196584 Jan 10 12:50:26.064187 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 252/505] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:25 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:26.275573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-84248813-0f24-4000-8c2b-1be546d86270 req-aeb1f30c-04bf-4d76-ba1d-4847b8583e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b25262-b3d3-43a6-a674-7bd204e45e31", "name": "network-vif-deleted", "tag": "d7de2099-ce7e-43d9-9a27-d9371be7127a"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:26.277129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:26.277129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:26.279048 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:26.279789 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:26.293398 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:26.293806 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.296564 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-84248813-0f24-4000-8c2b-1be546d86270 req-aeb1f30c-04bf-4d76-ba1d-4847b8583e5c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:26.297019 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-84248813-0f24-4000-8c2b-1be546d86270 req-aeb1f30c-04bf-4d76-ba1d-4847b8583e5c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.300552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:26.301011 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.329034 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-84248813-0f24-4000-8c2b-1be546d86270 req-aeb1f30c-04bf-4d76-ba1d-4847b8583e5c service nova] Creating event network-vif-deleted:d7de2099-ce7e-43d9-9a27-d9371be7127a for instance 81b25262-b3d3-43a6-a674-7bd204e45e31 on hv-cinder-maste Jan 10 12:50:26.346975 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-84248813-0f24-4000-8c2b-1be546d86270 req-aeb1f30c-04bf-4d76-ba1d-4847b8583e5c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078528 Jan 10 12:50:26.347938 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 253/506] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:26.459802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:26.460984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:26.471049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:26.472109 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.473195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:26.473886 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.494150 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:26.503939 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:26.506149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:26.507747 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-66e777e5-8edb-44c6-9abf-25028525fd42 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.241003 Jan 10 12:50:26.509142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 254/507] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:26 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:26.517342 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2254cef5-db81-4620-9af9-da12e554b513 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:26.518433 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2254cef5-db81-4620-9af9-da12e554b513 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:26.525742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2254cef5-db81-4620-9af9-da12e554b513 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:26.526464 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2254cef5-db81-4620-9af9-da12e554b513 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.527451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2254cef5-db81-4620-9af9-da12e554b513 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:26.528097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2254cef5-db81-4620-9af9-da12e554b513 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:26.648597 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:26.652628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2254cef5-db81-4620-9af9-da12e554b513 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 33042 microversion: 2.1 time: 0.138996 Jan 10 12:50:26.653282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 255/508] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:26 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 33042 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:26.661531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-59ad26cc-03a4-4894-9723-4cbbf152f939 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.206831 Jan 10 12:50:26.662261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 254/509] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:26 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:27.081402 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:27.082120 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 81b25262-b3d3-43a6-a674-7bd204e45e31] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:27.089389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.089831 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.090626 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.091053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.107686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] HTTP exception thrown: Instance 81b25262-b3d3-43a6-a674-7bd204e45e31 could not be found. Jan 10 12:50:27.108130 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Returning 404 to user: Instance 81b25262-b3d3-43a6-a674-7bd204e45e31 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:50:27.108977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5594920b-1086-4155-9089-c70d8f54cd18 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31" status: 404 len: 111 microversion: 2.1 time: 0.031777 Jan 10 12:50:27.109539 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 256/510] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:27 2022] GET /compute/v2.1/servers/81b25262-b3d3-43a6-a674-7bd204e45e31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:50:27.526675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:27.527257 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:27.534359 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.534359 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.535029 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.535459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.664582 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3fb35fc6-c682-4fe8-b55d-f5a7cd77435c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:27.665520 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3fb35fc6-c682-4fe8-b55d-f5a7cd77435c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:27.673107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:27.673321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3fb35fc6-c682-4fe8-b55d-f5a7cd77435c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.673321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3fb35fc6-c682-4fe8-b55d-f5a7cd77435c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.673813 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3fb35fc6-c682-4fe8-b55d-f5a7cd77435c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.674256 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3fb35fc6-c682-4fe8-b55d-f5a7cd77435c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.680170 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:27.681703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:27.682916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-645d67ba-048f-4963-9239-6a03cd2baf7d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.160281 Jan 10 12:50:27.683677 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 255/511] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:27 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:27.688270 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:27.688873 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:27.695157 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.695960 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.696762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:27.697199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:27.771197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3fb35fc6-c682-4fe8-b55d-f5a7cd77435c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 33575 microversion: 2.1 time: 0.110045 Jan 10 12:50:27.773682 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 257/512] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:27 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 33575 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:27.843035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:27.850995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-515a4f24-3876-43d7-a93b-1c2bb7a0cfe4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.166364 Jan 10 12:50:27.851582 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 256/513] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:27 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:28.252027 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:28.252616 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:28.259597 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.260052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.260831 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.261269 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.286902 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:50:28.366426 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-37220bdb-813f-4c4e-b45b-1d2c3c9c5e04 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 204 len: 0 microversion: 2.1 time: 0.118146 Jan 10 12:50:28.367151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 258/514] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:50:28 2022] DELETE /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:50:28.375324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:28.375963 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:28.382222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.382679 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.383466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.383934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.523674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:28.532807 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f20c7bc1-aef8-4257-a453-d7973d9f4dc3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1513 microversion: 2.1 time: 0.161150 Jan 10 12:50:28.533450 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 257/515] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:28 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:28.706388 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:28.707064 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:28.713992 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.714464 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.715320 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.715878 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.785766 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f2f0b514-d350-4a27-bbd2-7561a1f49da0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:28.787100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f2f0b514-d350-4a27-bbd2-7561a1f49da0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:28.793517 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f2f0b514-d350-4a27-bbd2-7561a1f49da0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.794043 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f2f0b514-d350-4a27-bbd2-7561a1f49da0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.794825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f2f0b514-d350-4a27-bbd2-7561a1f49da0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.795256 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f2f0b514-d350-4a27-bbd2-7561a1f49da0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.862808 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:28.871494 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:28.873045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:28.874302 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4483daaa-7310-42bb-a11d-f661166347af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.173420 Jan 10 12:50:28.874956 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 259/516] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:28 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:28.879152 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:28.879782 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:28.885239 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f2f0b514-d350-4a27-bbd2-7561a1f49da0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 34169 microversion: 2.1 time: 0.103207 Jan 10 12:50:28.886051 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 258/517] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:28 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 34169 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:28.886904 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.887352 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:28.888180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:28.888622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:29.024223 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:29.033256 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fe4fd37e-c9f3-422e-ae5f-b8746ea89bbc tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.157377 Jan 10 12:50:29.033838 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 260/518] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:28 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:29.562828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:29.563884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:29.573928 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:29.574495 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:29.575750 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:29.576386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:29.722657 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:29.730402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cf69397e-bed7-4f3e-87ef-520373542821 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1513 microversion: 2.1 time: 0.176099 Jan 10 12:50:29.731022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 259/519] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:29 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:29.892784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:29.894021 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:29.898724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ab143f40-8a64-4227-bb6b-24796989bd36 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:29.899833 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ab143f40-8a64-4227-bb6b-24796989bd36 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:29.901521 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:29.901967 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:29.902941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:29.905334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:29.906474 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab143f40-8a64-4227-bb6b-24796989bd36 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:29.907101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab143f40-8a64-4227-bb6b-24796989bd36 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:29.907753 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab143f40-8a64-4227-bb6b-24796989bd36 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:29.908193 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab143f40-8a64-4227-bb6b-24796989bd36 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:30.003391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ab143f40-8a64-4227-bb6b-24796989bd36 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 34812 microversion: 2.1 time: 0.108529 Jan 10 12:50:30.004084 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 260/520] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:29 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 34812 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:50:30.043260 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:30.050671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:30.051372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:30.052293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:30.053814 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:30.054999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-06b69f47-070d-4d51-96f8-8d5509af977d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.166295 Jan 10 12:50:30.055579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 261/521] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:29 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:30.058714 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:30.059165 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:30.060361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:30.060800 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:30.208147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:30.216851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-dae76f79-016a-48ed-b040-77e95558b62b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.170177 Jan 10 12:50:30.217543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 261/522] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:30 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:30.747138 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:30.747783 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:30.754497 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:30.754968 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:30.755802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:30.756248 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:30.913069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:30.923708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fcbbddbf-2472-42df-9b97-bdb6c57d70ee tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1513 microversion: 2.1 time: 0.180007 Jan 10 12:50:30.932881 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 262/523] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:30 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:30.981516 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-6320ed34-2566-4765-a6ee-f9dde1db79bc req-43f88c8a-f60f-44ed-bb6c-9515d255454f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32155711-e404-4e2a-9808-fb51a91d4775", "name": "network-vif-deleted", "tag": "95aaaa7e-e8c3-48fc-814b-58d23b3c5b2c"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:30.982267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:30.982267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:30.997058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6320ed34-2566-4765-a6ee-f9dde1db79bc req-43f88c8a-f60f-44ed-bb6c-9515d255454f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:30.997506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6320ed34-2566-4765-a6ee-f9dde1db79bc req-43f88c8a-f60f-44ed-bb6c-9515d255454f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.015323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-6320ed34-2566-4765-a6ee-f9dde1db79bc req-43f88c8a-f60f-44ed-bb6c-9515d255454f service nova] Creating event network-vif-deleted:95aaaa7e-e8c3-48fc-814b-58d23b3c5b2c for instance 32155711-e404-4e2a-9808-fb51a91d4775 on hv-cinder-maste Jan 10 12:50:31.016957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-389e9955-c3d9-4f08-b387-e67d0fa11f19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:31.017958 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-389e9955-c3d9-4f08-b387-e67d0fa11f19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:31.023574 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-6320ed34-2566-4765-a6ee-f9dde1db79bc req-43f88c8a-f60f-44ed-bb6c-9515d255454f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046172 Jan 10 12:50:31.025069 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 262/524] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:50:31.031809 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-389e9955-c3d9-4f08-b387-e67d0fa11f19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.032577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-389e9955-c3d9-4f08-b387-e67d0fa11f19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.034462 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-389e9955-c3d9-4f08-b387-e67d0fa11f19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.034462 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-389e9955-c3d9-4f08-b387-e67d0fa11f19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.078154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:31.078994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:31.089717 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.090470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.092726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.094175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.277574 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:31.291362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:31.293939 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:31.295532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-05a71e66-deec-4ae9-b5e9-827198b3e076 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.226048 Jan 10 12:50:31.296588 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 263/525] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:31 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:31.303267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:31.304085 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:31.311364 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.312282 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.313959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.314640 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.521708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:31.530215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5a8ef576-4a9e-4a6f-ad57-12434f5eb935 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.232356 Jan 10 12:50:31.530929 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 264/526] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:31 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:31.942350 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:31.943216 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:31.950828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.951378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:31.952283 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:31.953004 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:32.016736 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:32.025854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b63ff269-7c0e-448c-a29c-046d3672d3e9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.087206 Jan 10 12:50:32.026639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 265/527] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:31 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:32.314702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:32.315397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:32.321647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:32.322228 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:32.323135 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:32.323678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:32.463402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:32.473136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:32.474698 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:32.475865 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0bb723f6-5cf1-46ed-8e45-12f40d27fc62 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.165132 Jan 10 12:50:32.476660 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 266/528] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:32 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:32.548971 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:32.549737 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:32.556714 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:32.557205 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:32.558000 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:32.558438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:32.705518 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:32.713626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-13d694df-6742-4e17-bfb7-102f44654c05 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.169414 Jan 10 12:50:32.714213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 267/529] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:32 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:33.042409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:33.044091 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:33.051279 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:33.052090 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:33.053096 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:33.054049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:33.117475 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:33.125203 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-256831f7-79be-4271-8231-117dc0b92bbc tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.086649 Jan 10 12:50:33.125779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 268/530] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:33 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:33.504898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:33.505492 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:33.511609 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:33.512069 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:33.512871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:33.513308 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:33.663373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:33.673126 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:33.677049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:33.677049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ca39e6cf-49f2-4d61-ab54-b849c8306a45 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.175299 Jan 10 12:50:33.689709 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 269/531] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:33 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:33.731149 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:33.732064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:33.740118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:33.740649 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:33.741507 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:33.742037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:33.896567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:33.906452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-746eb0fe-8c55-4669-88d2-d3e50d163501 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.179899 Jan 10 12:50:33.907049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 270/532] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:33 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:34.141857 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:34.142503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:34.148846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:34.149297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:34.150067 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:34.150491 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:34.212710 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:34.228248 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-33a9ae96-d5eb-4bd7-8148-4853d9026920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.085004 Jan 10 12:50:34.228248 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 271/533] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:34 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:34.724816 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:34.726469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:34.736022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:34.736638 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:34.737974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:34.738703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:34.913508 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:34.922278 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:34.923856 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:34.925022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-06b9631e-6c26-4096-87ef-60a70a9f7ea9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.219494 Jan 10 12:50:34.925592 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 272/534] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:34 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:34.930458 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:34.931154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:34.938961 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:34.939414 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:34.940440 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:34.940982 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:35.093583 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:35.111875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4dd99199-a1bd-4a38-8431-1942079b0ac5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.184669 Jan 10 12:50:35.112645 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 273/535] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:34 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:35.243134 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:35.243918 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:35.251075 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:35.251556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:35.252371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:35.252805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:35.321515 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:35.330070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a700a290-8faf-491a-86ec-db9ae17d5b7b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.090613 Jan 10 12:50:35.330673 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 274/536] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:35 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:35.944808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:35.945592 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:35.956889 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:35.957485 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:35.963815 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:35.964410 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:36.121622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:36.133364 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:36.134920 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:36.136130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-77e6ee35-d623-4dda-b168-fa3fc0af7039 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.195287 Jan 10 12:50:36.136969 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 275/537] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:35 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:36.151388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:36.152035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:36.158114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:36.158564 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:36.159342 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:36.159802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:36.308896 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:36.317429 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-50d89cf4-0199-42c4-b356-7b48b6101cfb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.169849 Jan 10 12:50:36.317992 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 276/538] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:36 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:36.347176 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:36.347825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:36.354169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:36.354633 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:36.355441 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:36.355919 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:36.420055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:36.427737 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ac4deed5-a879-44d5-8e4b-197739afe052 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.084256 Jan 10 12:50:36.428327 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 277/539] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:36 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:37.154318 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:37.154937 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:37.162439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:37.162899 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:37.163985 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:37.164429 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:37.316488 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:37.326072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:37.330821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:37.336991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0f4cffa7-b317-4a1c-9d3e-531cd9b144a4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.186358 Jan 10 12:50:37.338223 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 278/540] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:37 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:37.343117 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:37.343977 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:37.350086 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:37.350541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:37.351531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:37.351978 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:37.502317 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:37.511111 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c7c93aa2-0886-40d9-bfd4-e69dd0e8a7e3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.171731 Jan 10 12:50:37.511777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 279/541] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:37 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:37.516442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:37.517063 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:37.523830 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:37.524282 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:37.525065 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:37.525509 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:37.590674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:37.598596 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-96ec4ad2-615e-4aad-ac2e-c6ee811b3b56 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.085683 Jan 10 12:50:37.599445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 280/542] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:37 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:38.355653 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:38.356355 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:38.362725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:38.363175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:38.363989 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:38.366933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:38.508840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:38.518342 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:38.519936 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:38.521131 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ddde3b5a-5cd3-4820-b7ce-005095f64aa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.169315 Jan 10 12:50:38.523719 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 281/543] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:38 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:38.528094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:38.528720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:38.536133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:38.538130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:38.539103 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:38.539559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:38.683721 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:38.693861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0a09ab0b-31cb-49e9-aab7-b543d5d8c551 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.169163 Jan 10 12:50:38.699573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 282/544] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:38 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:38.705119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:38.705731 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:38.719610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:38.719610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:38.719610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:38.719610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:38.776228 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:38.784210 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7c364d8d-2cea-4a5d-bc9b-f747d53213f9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.083369 Jan 10 12:50:38.784931 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 283/545] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:38 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:39.544133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:39.544897 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:39.555050 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:39.555695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:39.556862 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:39.557465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:39.702629 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:39.711462 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:39.713054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:39.714297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-95f9f7cf-8b6e-47af-844f-9af20f99731c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.174016 Jan 10 12:50:39.714937 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 284/546] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:39 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:39.719419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:39.720083 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:39.728267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:39.729108 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:39.730144 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:39.730796 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:39.898840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:39.907880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3654e580-1798-4dec-92df-18d8f648c607 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.191812 Jan 10 12:50:39.908600 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 285/547] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:39 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:39.915263 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:39.916039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:39.922170 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:39.922616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:39.923383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:39.923861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:39.985538 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:39.994943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-985faf61-ea49-4f58-ade9-d78be14f0b68 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.083360 Jan 10 12:50:39.996035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 286/548] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:39 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:40.733120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:40.734541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:40.740880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:40.741663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:40.742686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:40.743341 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:40.891812 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:40.900782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:40.902323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:40.903487 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fe92415e-027c-4af3-9a04-bc2eec38de9b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.174706 Jan 10 12:50:40.904073 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 287/549] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:40 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:40.927435 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:40.928354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:40.937541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:40.938190 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:40.939406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:40.940065 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:41.085658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:41.095725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b56d0e94-365d-4720-b611-64f266a5c725 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.174806 Jan 10 12:50:41.096637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 288/550] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:40 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:41.101047 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:41.101648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:41.108059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:41.108636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:41.109509 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:41.110204 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:41.190344 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:41.198346 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1490e7e1-f2f8-4d66-9ca3-c83b33a1f89e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.100798 Jan 10 12:50:41.198940 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 289/551] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:41 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:41.926230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:41.927666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:41.933605 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:41.934098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:41.935245 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:41.935718 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:42.071901 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:42.080953 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:42.082451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:42.083958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0b4cc195-9a3b-499a-9014-f48465e511cd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.164282 Jan 10 12:50:42.084526 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 290/552] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:41 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:42.116515 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:42.117397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:42.126838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:42.127487 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:42.128620 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:42.129124 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:42.268107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:42.276534 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ef5d5364-cf35-44a8-a531-d018a14784f1 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.165914 Jan 10 12:50:42.277113 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 291/553] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:42 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:42.281326 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:42.281916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:42.287555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:42.288017 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:42.288781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:42.289210 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:42.362077 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:42.374435 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9fde4ced-d222-48ba-993c-b6283d83a6a3 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1302 microversion: 2.1 time: 0.096071 Jan 10 12:50:42.375244 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 292/554] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:42 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:42.945068 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-389e9955-c3d9-4f08-b387-e67d0fa11f19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 200 len: 38232 microversion: 2.1 time: 11.931914 Jan 10 12:50:42.947635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 263/555] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:31 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 38232 bytes in 11935 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:50:42.957275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b50d1fa6-4831-48f9-8430-91f645b82382 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:42.958765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b50d1fa6-4831-48f9-8430-91f645b82382 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:42.967314 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b50d1fa6-4831-48f9-8430-91f645b82382 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:42.968752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b50d1fa6-4831-48f9-8430-91f645b82382 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:42.969532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b50d1fa6-4831-48f9-8430-91f645b82382 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:42.971479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b50d1fa6-4831-48f9-8430-91f645b82382 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.003142 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b50d1fa6-4831-48f9-8430-91f645b82382 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/ips" status: 200 len: 145 microversion: 2.1 time: 0.049508 Jan 10 12:50:43.011447 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 293/556] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jan 10 12:50:42 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/ips => generated 145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:43.103421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:43.104174 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:43.110654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:43.111105 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.111921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:43.112357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.254024 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:43.264346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:43.265929 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:43.267117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9e109438-e7bb-4f3a-b9ad-0f64070c5325 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.168603 Jan 10 12:50:43.267709 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 264/557] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:43 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:43.292905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:43.293555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:43.299708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:43.300167 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.300945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:43.301556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.393340 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:43.394006 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:43.402526 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:43.402993 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.403790 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:43.404415 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.440535 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:43.440989 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:43.441440 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lazy-loading 'fault' on Instance uuid 32155711-e404-4e2a-9808-fb51a91d4775 {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:50:43.441631 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:43.449566 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a8478beb-33cf-48eb-8710-a16a87388a2b tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.160351 Jan 10 12:50:43.450145 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 294/558] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:43 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:43.483794 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:43.493956 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a9c26c6b-5cec-472b-a8db-a24da0b2b24c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 200 len: 1307 microversion: 2.1 time: 0.104560 Jan 10 12:50:43.494528 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 265/559] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:43 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:44.094450 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7657d992-28a9-4d32-80b9-74967e7a059c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bd8869c-6221-4da8-81fc-689f5ccc1102", "device": "/dev/sdb"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:44.096345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7657d992-28a9-4d32-80b9-74967e7a059c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:44.103344 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7657d992-28a9-4d32-80b9-74967e7a059c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.103842 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7657d992-28a9-4d32-80b9-74967e7a059c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.104635 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7657d992-28a9-4d32-80b9-74967e7a059c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.105067 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7657d992-28a9-4d32-80b9-74967e7a059c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.285531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:44.286213 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:44.293578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.294000 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.294802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.295257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.355085 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7657d992-28a9-4d32-80b9-74967e7a059c tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "POST /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263568 Jan 10 12:50:44.360686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 295/560] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:50:44 2022] POST /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:44.450030 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:44.459682 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:44.467064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:44.467954 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:44.471489 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:44.474817 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fbf81077-357c-4aa8-9510-6135cc9cdc8b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.192981 Jan 10 12:50:44.475480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 266/561] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:44 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:44.475735 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.476199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.477037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.477478 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.511722 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:44.512341 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 32155711-e404-4e2a-9808-fb51a91d4775] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:44.522132 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.522579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.523864 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.524226 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.541421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] HTTP exception thrown: Instance 32155711-e404-4e2a-9808-fb51a91d4775 could not be found. Jan 10 12:50:44.542488 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Returning 404 to user: Instance 32155711-e404-4e2a-9808-fb51a91d4775 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:50:44.543335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-11210f9a-143e-4916-a5c5-a0dd46b011a1 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775" status: 404 len: 111 microversion: 2.1 time: 0.036238 Jan 10 12:50:44.544142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 267/562] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:44 2022] GET /compute/v2.1/servers/32155711-e404-4e2a-9808-fb51a91d4775 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 12:50:44.552375 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:44.552876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:44.560081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.560713 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.561818 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.562042 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.590659 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:50:44.630483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:44.655244 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4365e902-ca22-4d92-8e38-2317db4cb13c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.191620 Jan 10 12:50:44.657300 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 296/563] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:44 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:44.681772 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0bbf2dce-1a27-438b-a26c-8528f3e32678 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 204 len: 0 microversion: 2.1 time: 0.133019 Jan 10 12:50:44.683054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 268/564] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:50:44 2022] DELETE /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:50:44.692595 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:44.693074 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:44.700277 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.700944 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.701598 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:44.702036 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:44.848808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:44.857368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-76865130-4ad2-4cd7-9522-91fca8207920 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1513 microversion: 2.1 time: 0.169000 Jan 10 12:50:44.867353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 297/565] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:44 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:45.494199 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:45.494895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:45.501215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.501694 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:45.502463 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.502906 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:45.647800 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:45.656107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:45.657594 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:45.658760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-826206b4-5638-458a-8a19-dd08f53435b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.169405 Jan 10 12:50:45.659330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 269/566] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:45 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:45.673089 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:45.673732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:45.680784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.681258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:45.682034 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.682473 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:45.781347 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-da033c75-939e-43ff-b760-30c039e0cc1f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8170bf09-57f7-4922-aa3c-fc18c7b2b155"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:45.782473 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-da033c75-939e-43ff-b760-30c039e0cc1f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:45.788888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da033c75-939e-43ff-b760-30c039e0cc1f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.789332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da033c75-939e-43ff-b760-30c039e0cc1f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:45.790107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da033c75-939e-43ff-b760-30c039e0cc1f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.790536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-da033c75-939e-43ff-b760-30c039e0cc1f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:45.824165 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:45.832741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ad315ff5-5ec5-41c2-834f-71d612ce9403 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1568 microversion: 2.1 time: 0.163391 Jan 10 12:50:45.841760 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 298/567] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:45 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:45.873933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:45.874546 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:45.880636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.881175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:45.881968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:45.882399 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:46.030543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:46.038047 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ee86f3e9-f4b2-4a26-872e-7dfcd3b08bc8 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1513 microversion: 2.1 time: 0.167726 Jan 10 12:50:46.038793 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 299/568] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:45 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:46.063984 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-da033c75-939e-43ff-b760-30c039e0cc1f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286247 Jan 10 12:50:46.064617 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 270/569] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:50:45 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:46.480803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-119614961", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-174268589", "security_groups": [{"name": "tempest-secgroup-smoke-849435366"}], "block_device_mapping_v2": [{"uuid": "ab7a1724-91fb-4de8-88d9-dd9d70f3b996", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c5b8c8b5-d1c3-4f27-9dc6-e0e5ca957245"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:46.596738 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] validate_networks() for [('c5b8c8b5-d1c3-4f27-9dc6-e0e5ca957245', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:50:46.677371 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:46.678886 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:46.685938 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:46.686702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:46.687750 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:46.688398 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:46.869675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:46.878980 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:46.881182 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:46.882507 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9e2b44d9-422e-4a18-8cd4-5f6e9c32d2b4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.209198 Jan 10 12:50:46.893505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 271/570] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:46 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:46.898523 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:46.899416 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:46.905714 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:46.906164 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:46.906962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:46.907394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.141671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:47.155012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6ddfa38f-5124-49b8-833e-b978e4a3f463 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1548 microversion: 2.1 time: 0.260035 Jan 10 12:50:47.156290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 272/571] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:46 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1548 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:47.163146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:47.164172 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:47.169340 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:50:47.169844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:50:47.170240 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:50:47.170645 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:50:47.171058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:50:47.174239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.174702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.175706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.176212 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.184038 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.184860 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.185678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.186116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.203716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:50:47.207599 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for user ffd65d5f1d484d48a3ed84cf1592956c and project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:50:47.269777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:50:47.272412 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab7a1724-91fb-4de8-88d9-dd9d70f3b996',volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:50:47.468901 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-eec27c2e-413f-4536-b64f-a497e01b3acd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.991986 Jan 10 12:50:47.469658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 300/572] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:50:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:50:47.499352 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:47.500054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:47.509984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.510871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.511901 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.512666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.524807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:47.534102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-22414112-145f-43d0-8817-244abf329091 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 200 len: 1513 microversion: 2.1 time: 0.376161 Jan 10 12:50:47.543346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 273/573] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:47 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 1513 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:47.543346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-827fadf9-eb79-4393-a354-a4025d939af0 req-c26dd912-e02d-4b69-98cc-1ed157d4aa22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ba5e7b-b15f-4980-aeee-11985b35b076", "name": "network-vif-deleted", "tag": "cae30eac-1be6-45e1-a371-f67ef66276f8"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:47.543346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:47.543346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:50:47.565992 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-827fadf9-eb79-4393-a354-a4025d939af0 req-c26dd912-e02d-4b69-98cc-1ed157d4aa22 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.569222 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-827fadf9-eb79-4393-a354-a4025d939af0 req-c26dd912-e02d-4b69-98cc-1ed157d4aa22 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.604276 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-827fadf9-eb79-4393-a354-a4025d939af0 req-c26dd912-e02d-4b69-98cc-1ed157d4aa22 service nova] Creating event network-vif-deleted:cae30eac-1be6-45e1-a371-f67ef66276f8 for instance 22ba5e7b-b15f-4980-aeee-11985b35b076 on hv-cinder-maste Jan 10 12:50:47.610051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-827fadf9-eb79-4393-a354-a4025d939af0 req-c26dd912-e02d-4b69-98cc-1ed157d4aa22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072739 Jan 10 12:50:47.610540 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 274/574] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:47.617814 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-541b7523-5024-4787-80eb-0b39678ec546 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:47.618855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-541b7523-5024-4787-80eb-0b39678ec546 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:47.652857 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] HTTP exception thrown: Cannot 'detach_volume' instance e102ed1c-55c4-488a-9729-a99f58666989 while it is in vm_state rescued Jan 10 12:50:47.653597 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Returning 409 to user: Cannot 'detach_volume' instance e102ed1c-55c4-488a-9729-a99f58666989 while it is in vm_state rescued {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:50:47.654580 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5794f2cc-f1b7-4620-a39a-ad1dfb12fd37 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments/95771858-ecd9-4e3a-a99f-fc0a0247a5c6" status: 409 len: 152 microversion: 2.1 time: 0.183885 Jan 10 12:50:47.655295 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 301/575] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:50:47 2022] DELETE /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments/95771858-ecd9-4e3a-a99f-fc0a0247a5c6 => generated 152 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 10 12:50:47.664199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-da137590-f85f-4f26-a465-bf48576f3b87 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:47.665568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-da137590-f85f-4f26-a465-bf48576f3b87 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:47.673163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da137590-f85f-4f26-a465-bf48576f3b87 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.673832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da137590-f85f-4f26-a465-bf48576f3b87 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.674990 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da137590-f85f-4f26-a465-bf48576f3b87 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.675567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da137590-f85f-4f26-a465-bf48576f3b87 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.677199 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-541b7523-5024-4787-80eb-0b39678ec546 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:47.684733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-541b7523-5024-4787-80eb-0b39678ec546 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1093 microversion: 2.1 time: 0.072520 Jan 10 12:50:47.685394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 275/576] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:47 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:47.745299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-da137590-f85f-4f26-a465-bf48576f3b87 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action" status: 202 len: 0 microversion: 2.1 time: 0.084989 Jan 10 12:50:47.747701 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 302/577] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:50:47 2022] POST /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:50:47.757208 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:47.758097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:47.765388 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.766058 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.767026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.767462 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.900732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:47.901682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:47.908724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.909662 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:47.910445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.911255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:47.911964 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:47.919734 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7162f2aa-c9a6-4944-a43c-2ab32562cfc5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1556 microversion: 2.1 time: 0.167102 Jan 10 12:50:47.920351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 276/578] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:47 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:48.080317 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:48.090777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:48.093111 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:48.094290 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-99e52ce3-01cc-4cb7-a0f7-29d91f710e69 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.197820 Jan 10 12:50:48.095541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 303/579] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:47 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:48.552081 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:48.552731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 22ba5e7b-b15f-4980-aeee-11985b35b076] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:48.558888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:48.559706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:48.560509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:48.560953 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:48.576244 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] HTTP exception thrown: Instance 22ba5e7b-b15f-4980-aeee-11985b35b076 could not be found. Jan 10 12:50:48.577074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Returning 404 to user: Instance 22ba5e7b-b15f-4980-aeee-11985b35b076 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:50:48.577964 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-69f95ba6-d998-4ac6-a032-dc7a7b4fee3b tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076" status: 404 len: 111 microversion: 2.1 time: 0.030745 Jan 10 12:50:48.578608 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 277/580] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:48 2022] GET /compute/v2.1/servers/22ba5e7b-b15f-4980-aeee-11985b35b076 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:50:48.709380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:48.710110 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:48.725684 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:48.726319 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:48.727280 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:48.727809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:48.802849 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:48.810669 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e6e158a8-ca62-4c14-bf65-318c1c63e730 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1209 microversion: 2.1 time: 0.105308 Jan 10 12:50:48.811244 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 304/581] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:48 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:48.937234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:48.937844 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:48.944902 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:48.945361 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:48.946137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:48.946652 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.083617 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:49.091895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c77dc814-a13c-49ae-aa0f-f1a15ddd58f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1556 microversion: 2.1 time: 0.158713 Jan 10 12:50:49.092568 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 278/582] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:48 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:49.113049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:49.113657 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:49.119859 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.120334 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.121120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.121555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.258739 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:49.267721 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:49.269281 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:49.270441 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-05046d7a-f2bf-4a59-a305-4b304f76bc36 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.161201 Jan 10 12:50:49.271575 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 305/583] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:49 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:49.732710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:49.733215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:49.742018 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.742672 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.743694 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.744276 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.772428 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:50:49.827150 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:49.828513 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:49.841825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.843330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.844857 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.845529 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.863615 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9f969abd-837f-4de1-98e3-486556fb5aae tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "DELETE /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 204 len: 0 microversion: 2.1 time: 0.135045 Jan 10 12:50:49.865109 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 279/584] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:50:49 2022] DELETE /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:50:49.882220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:49.882931 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:49.893734 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.894366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:49.895610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:49.896235 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:50.067627 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:50.076037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9e5829a6-b5e8-4de3-9070-f0266de8a8e9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.252642 Jan 10 12:50:50.076921 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 306/585] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:49 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:50:50.081521 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-8dea5d7e-8eff-4d82-9994-97d9391bcb02 req-f842e50d-92b7-4d2b-90e8-54f7a33af304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508c5420-5725-4665-b594-8990cf7bc668", "tag": "b0c8664c-1be2-4aa4-ad7d-298feadd5169"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:50.083273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:50.083273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:50.098020 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-8dea5d7e-8eff-4d82-9994-97d9391bcb02 req-f842e50d-92b7-4d2b-90e8-54f7a33af304 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:50.098884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-8dea5d7e-8eff-4d82-9994-97d9391bcb02 req-f842e50d-92b7-4d2b-90e8-54f7a33af304 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:50.111777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-8dea5d7e-8eff-4d82-9994-97d9391bcb02 req-f842e50d-92b7-4d2b-90e8-54f7a33af304 service nova] Creating event network-changed:b0c8664c-1be2-4aa4-ad7d-298feadd5169 for instance 508c5420-5725-4665-b594-8990cf7bc668 on hv-cinder-maste Jan 10 12:50:50.119093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-8dea5d7e-8eff-4d82-9994-97d9391bcb02 req-f842e50d-92b7-4d2b-90e8-54f7a33af304 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040814 Jan 10 12:50:50.120079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 307/586] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:50.128281 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:50.129284 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:50.136301 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:50.137149 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:50.138352 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:50.138979 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:50.144308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:50.153430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2fc6953f-bcde-4b25-be96-6160102d7b17 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1514 microversion: 2.1 time: 0.280546 Jan 10 12:50:50.163981 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 280/587] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:49 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:50.280104 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:50.289574 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bc54d6b0-1e50-48f4-a5ae-adbf31c4a65a tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1556 microversion: 2.1 time: 0.166053 Jan 10 12:50:50.290324 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:50.291016 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:50.300328 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 308/588] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:50 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:50.305433 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:50.305935 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:50.306668 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:50.307101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:50.457505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:50.466101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:50.467628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:50.468788 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-551fe41f-0655-4494-9570-c50daee8b704 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.183672 Jan 10 12:50:50.469564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 281/589] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:50 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:51.092129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:51.092736 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:51.102363 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.102826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.103754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.104715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.170363 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:51.170928 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:51.178892 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.179278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.180148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.180591 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.294502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:51.302641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ab1d85f6-1c29-482e-af78-17c59d4445eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.213678 Jan 10 12:50:51.302641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 309/590] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:51 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:51.307740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:51.308349 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:51.316759 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.317230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.318208 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.318645 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.389374 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:51.398799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cdb246ef-5f92-44c3-af4a-718416dad367 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1514 microversion: 2.1 time: 0.232103 Jan 10 12:50:51.399395 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 282/591] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:51 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:51.470247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:51.478579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2701e4e0-5121-4c50-979e-c3eedd505f17 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1562 microversion: 2.1 time: 0.174846 Jan 10 12:50:51.479098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 310/592] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:51 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:51.487798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:51.488778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:51.497008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.497695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.498791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.499229 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.552413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:51.553141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:51.558933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.560077 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.560884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.561368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.647956 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:51.648070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lazy-loading 'services' on Instance uuid e102ed1c-55c4-488a-9729-a99f58666989 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:50:51.659291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:51.661376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:51.663303 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-68ad4a59-0a8a-4b88-b52f-b60e558acc7e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.178733 Jan 10 12:50:51.664010 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 283/593] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:51 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:50:51.719450 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-66ea8051-9b29-4081-9a04-5234c57f5413 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments/95771858-ecd9-4e3a-a99f-fc0a0247a5c6" status: 202 len: 0 microversion: 2.1 time: 0.170966 Jan 10 12:50:51.720093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 311/594] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:50:51 2022] DELETE /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments/95771858-ecd9-4e3a-a99f-fc0a0247a5c6 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:50:51.728439 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ff89e996-4de5-4d9e-8fcd-626825eddc80 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:51.729422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ff89e996-4de5-4d9e-8fcd-626825eddc80 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:51.735541 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ff89e996-4de5-4d9e-8fcd-626825eddc80 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.736030 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ff89e996-4de5-4d9e-8fcd-626825eddc80 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.736793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ff89e996-4de5-4d9e-8fcd-626825eddc80 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:51.737261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ff89e996-4de5-4d9e-8fcd-626825eddc80 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:51.768453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ff89e996-4de5-4d9e-8fcd-626825eddc80 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Jan 10 12:50:51.769038 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 284/595] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:51 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:52.320796 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:52.321531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:52.328234 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.328682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.329467 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.329909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.415921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:52.416508 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:52.423361 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.424105 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.425120 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.425650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.493102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:52.502164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6ed31254-39cf-4e1f-9fc0-19529b183885 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.187488 Jan 10 12:50:52.512622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 312/596] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:52 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:52.574811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-b2a34811-ee93-4b13-b2d8-bbb9044536e7 req-f1242dc2-ebd3-4909-a944-8b9a8a668f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03af44ba-8887-46a6-8431-a348b4376790", "name": "network-vif-deleted", "tag": "6c86b883-3cd7-458e-b400-d77a0e4ebea6"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:52.577615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:52.577615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:52.586503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b2a34811-ee93-4b13-b2d8-bbb9044536e7 req-f1242dc2-ebd3-4909-a944-8b9a8a668f4c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.586946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b2a34811-ee93-4b13-b2d8-bbb9044536e7 req-f1242dc2-ebd3-4909-a944-8b9a8a668f4c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.598261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-b2a34811-ee93-4b13-b2d8-bbb9044536e7 req-f1242dc2-ebd3-4909-a944-8b9a8a668f4c service nova] Creating event network-vif-deleted:6c86b883-3cd7-458e-b400-d77a0e4ebea6 for instance 03af44ba-8887-46a6-8431-a348b4376790 on hv-cinder-maste Jan 10 12:50:52.600023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:52.603988 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-b2a34811-ee93-4b13-b2d8-bbb9044536e7 req-f1242dc2-ebd3-4909-a944-8b9a8a668f4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Jan 10 12:50:52.604621 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 313/597] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:52.607601 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e82cf102-6fac-41eb-81c5-1a0572f7baac tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1514 microversion: 2.1 time: 0.195802 Jan 10 12:50:52.613757 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 285/598] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:52 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:52.687214 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:52.688433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:52.696744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.697195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.697971 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.698403 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.783415 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ddf163b2-df8a-4524-a4b0-a5f4d74b851f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:52.784800 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ddf163b2-df8a-4524-a4b0-a5f4d74b851f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:52.791653 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddf163b2-df8a-4524-a4b0-a5f4d74b851f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.792109 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddf163b2-df8a-4524-a4b0-a5f4d74b851f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.792934 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddf163b2-df8a-4524-a4b0-a5f4d74b851f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:52.793405 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddf163b2-df8a-4524-a4b0-a5f4d74b851f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:52.824649 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ddf163b2-df8a-4524-a4b0-a5f4d74b851f tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047454 Jan 10 12:50:52.825256 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 286/599] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:52 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:52.846557 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:52.855544 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:52.857081 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:52.858251 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9677f900-d3eb-480c-a42a-525797e455c4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.178314 Jan 10 12:50:52.858816 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 314/600] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:52 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:53.522104 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:53.522685 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:53.531596 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.532183 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:53.533514 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.534373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:53.623594 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:53.624207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:53.631251 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.631738 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:53.632524 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.632959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:53.690396 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:53.697970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-73d62d53-2de4-411b-9954-1b14b93244dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.181504 Jan 10 12:50:53.698509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 287/601] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:53 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:53.704568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:53.712570 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3c36e2a1-dd48-4b71-8e8d-5f2dc3671d9c tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1303 microversion: 2.1 time: 0.092675 Jan 10 12:50:53.713112 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 315/602] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:53 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:53.836824 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ea79208a-f685-4f2a-898c-6f5bcc845308 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:53.837741 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ea79208a-f685-4f2a-898c-6f5bcc845308 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:53.844310 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ea79208a-f685-4f2a-898c-6f5bcc845308 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.844763 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ea79208a-f685-4f2a-898c-6f5bcc845308 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:53.845551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ea79208a-f685-4f2a-898c-6f5bcc845308 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.845990 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ea79208a-f685-4f2a-898c-6f5bcc845308 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:53.877053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ea79208a-f685-4f2a-898c-6f5bcc845308 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Jan 10 12:50:53.877622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 288/603] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:53 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:53.877844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:53.878471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:53.887391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.888047 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:53.889161 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:53.889744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.029956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:54.038853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:54.040387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:54.041552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-315a5716-37ac-486f-bf2f-02298126769a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.167492 Jan 10 12:50:54.042114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 316/604] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:53 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:54.719033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:54.720034 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:54.731228 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:54.732041 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.733350 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:54.734090 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.741417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:54.742050 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:54.748814 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:54.749268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.750065 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:54.750502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.783483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:54.783872 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.784323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lazy-loading 'fault' on Instance uuid 03af44ba-8887-46a6-8431-a348b4376790 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:50:54.828518 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0513eaec53d241f398508dec85f017d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2f029676f249c681ad86a3f68525e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:54.836134 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-184a0528-4e2f-4451-86d8-1610bc1bfac9 tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 200 len: 1308 microversion: 2.1 time: 0.109591 Jan 10 12:50:54.836720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 317/605] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:54 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:54.888696 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-21e9f2b5-a5e3-4614-af73-a81dfe2a5864 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:54.889702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-21e9f2b5-a5e3-4614-af73-a81dfe2a5864 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:54.896364 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-21e9f2b5-a5e3-4614-af73-a81dfe2a5864 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:54.896635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:54.896805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-21e9f2b5-a5e3-4614-af73-a81dfe2a5864 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.897828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-21e9f2b5-a5e3-4614-af73-a81dfe2a5864 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:54.898407 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-21e9f2b5-a5e3-4614-af73-a81dfe2a5864 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:54.906641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7cfbcdfa-fc79-4b9b-b358-991cbba21648 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.193622 Jan 10 12:50:54.907446 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 289/606] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:54 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:54.931722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-21e9f2b5-a5e3-4614-af73-a81dfe2a5864 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046765 Jan 10 12:50:54.932294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 318/607] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:54 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:50:55.065537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:55.066054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:55.073096 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.073550 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.074331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.074772 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.218851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:55.227984 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:55.229547 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:55.230708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7f039c82-50ca-4da9-b8d7-66ed6fb2b414 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.169150 Jan 10 12:50:55.231325 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 290/608] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:55 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:55.854928 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:55.855538 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] [instance: 03af44ba-8887-46a6-8431-a348b4376790] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:55.862606 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.863060 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.863883 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.864321 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.878227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] HTTP exception thrown: Instance 03af44ba-8887-46a6-8431-a348b4376790 could not be found. Jan 10 12:50:55.878738 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] Returning 404 to user: Instance 03af44ba-8887-46a6-8431-a348b4376790 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:50:55.879554 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9bb573a6-edfa-486c-8616-31682069163e tempest-AttachVolumeNegativeTest-1205116751 tempest-AttachVolumeNegativeTest-1205116751-project] 10.222.0.13 "GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790" status: 404 len: 111 microversion: 2.1 time: 0.028476 Jan 10 12:50:55.880137 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 319/609] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:55 2022] GET /compute/v2.1/servers/03af44ba-8887-46a6-8431-a348b4376790 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:50:55.925117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:55.925739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:55.932737 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.933182 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.933965 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.934732 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.944059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-556d1ca7-aecd-4b19-9c82-3de5ecd7935e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:55.944974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-556d1ca7-aecd-4b19-9c82-3de5ecd7935e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:55.951353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-556d1ca7-aecd-4b19-9c82-3de5ecd7935e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.951839 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-556d1ca7-aecd-4b19-9c82-3de5ecd7935e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.953096 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-556d1ca7-aecd-4b19-9c82-3de5ecd7935e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:55.953096 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-556d1ca7-aecd-4b19-9c82-3de5ecd7935e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:55.982845 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-556d1ca7-aecd-4b19-9c82-3de5ecd7935e tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042807 Jan 10 12:50:55.985247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 320/610] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:55 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:56.189850 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:56.200026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-38bb6a1e-65cb-4023-89e2-5facd68ec0f0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.278552 Jan 10 12:50:56.200739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 291/611] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:55 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:56.226372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-01e51780-91c9-438f-82a8-4b1413ce6f5b req-4a3a2aa9-3aed-4944-9ae1-05bdea172755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3436ba09-022f-4b36-987d-667c236d68d1", "name": "network-vif-plugged", "status": "completed", "tag": "0341fd05-df0a-4b20-a713-82457a146a1c"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:50:56.229503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:50:56.229503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:50:56.239845 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-01e51780-91c9-438f-82a8-4b1413ce6f5b req-4a3a2aa9-3aed-4944-9ae1-05bdea172755 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:56.240463 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-01e51780-91c9-438f-82a8-4b1413ce6f5b req-4a3a2aa9-3aed-4944-9ae1-05bdea172755 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:56.250496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:56.251250 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:56.260596 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:56.262898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:56.263747 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:56.264182 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:56.275138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-01e51780-91c9-438f-82a8-4b1413ce6f5b req-4a3a2aa9-3aed-4944-9ae1-05bdea172755 service nova] Creating event network-vif-plugged:0341fd05-df0a-4b20-a713-82457a146a1c for instance 3436ba09-022f-4b36-987d-667c236d68d1 on hv-cinder-maste Jan 10 12:50:56.291255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-01e51780-91c9-438f-82a8-4b1413ce6f5b req-4a3a2aa9-3aed-4944-9ae1-05bdea172755 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069095 Jan 10 12:50:56.292800 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 321/612] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:56.651066 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:56.663716 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:56.665217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:56.666401 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5ebd5b07-bb89-4d5e-ab69-1e35efb5c914 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.420676 Jan 10 12:50:56.686816 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 292/613] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:56 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:56.996713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c08b076e-15eb-4809-8279-5a9e8b26227c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:56.997709 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c08b076e-15eb-4809-8279-5a9e8b26227c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:57.004569 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c08b076e-15eb-4809-8279-5a9e8b26227c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:57.005026 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c08b076e-15eb-4809-8279-5a9e8b26227c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:57.006109 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c08b076e-15eb-4809-8279-5a9e8b26227c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:57.006489 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c08b076e-15eb-4809-8279-5a9e8b26227c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:57.041604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c08b076e-15eb-4809-8279-5a9e8b26227c tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049062 Jan 10 12:50:57.042659 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 322/614] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:56 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:57.217924 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:57.218558 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:57.225333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:57.225798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:57.226580 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:57.227035 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:57.362641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:57.370895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f2e75c75-31c4-468a-ae00-8f7d5ba99169 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.156966 Jan 10 12:50:57.371474 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 293/615] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:57 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:57.684178 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:57.685147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:57.691539 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:57.691993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:57.692828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:57.693690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:57.841549 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:57.850462 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:57.852018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:57.853170 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-db27f978-b1f5-47f2-b6c2-b3cc0a9b28a2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.172796 Jan 10 12:50:57.853741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 323/616] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:57 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:58.053096 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a47db4e9-1a88-4b43-b347-37863bda2fe6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:58.054029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a47db4e9-1a88-4b43-b347-37863bda2fe6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:58.060400 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a47db4e9-1a88-4b43-b347-37863bda2fe6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:58.060857 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a47db4e9-1a88-4b43-b347-37863bda2fe6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:58.061646 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a47db4e9-1a88-4b43-b347-37863bda2fe6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:58.062088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a47db4e9-1a88-4b43-b347-37863bda2fe6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:58.092629 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a47db4e9-1a88-4b43-b347-37863bda2fe6 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Jan 10 12:50:58.093194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 294/617] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:58 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:58.387582 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:58.388160 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:58.394237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:58.394683 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:58.395453 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:58.395993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:58.545511 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:58.553513 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c83a3db3-1a97-4b2c-ad92-88674925a29a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.169457 Jan 10 12:50:58.554093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 324/618] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:58 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:50:58.870494 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:58.871099 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:58.877923 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:58.878381 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:58.879168 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:58.879610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:59.018351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:59.029610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:59.031111 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:59.032396 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-83de5ec5-ac8e-41da-a31f-40779b1e2aef tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.165708 Jan 10 12:50:59.033461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 295/619] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:50:58 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:50:59.105399 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-33d03ead-2140-49f6-ab58-9972b7921383 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:59.106337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-33d03ead-2140-49f6-ab58-9972b7921383 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:59.112577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33d03ead-2140-49f6-ab58-9972b7921383 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:59.113030 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33d03ead-2140-49f6-ab58-9972b7921383 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:59.113803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33d03ead-2140-49f6-ab58-9972b7921383 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:59.114243 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-33d03ead-2140-49f6-ab58-9972b7921383 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:59.144286 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-33d03ead-2140-49f6-ab58-9972b7921383 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Jan 10 12:50:59.144854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 325/620] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:50:59 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:50:59.571205 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:50:59.572032 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:50:59.578756 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:59.579256 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:59.580064 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:50:59.580502 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:50:59.721437 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:50:59.731870 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9ba54410-42b7-40b5-8c7b-b0b03b38a10c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.165116 Jan 10 12:50:59.732474 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 296/621] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:50:59 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:00.054267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:00.055487 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:00.063153 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:00.063655 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:00.064482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:00.064925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:00.161231 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-51852891-f34a-4d40-bc50-bbdb7c5f75be tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:00.162266 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-51852891-f34a-4d40-bc50-bbdb7c5f75be tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:00.168768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-51852891-f34a-4d40-bc50-bbdb7c5f75be tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:00.169162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-51852891-f34a-4d40-bc50-bbdb7c5f75be tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:00.169946 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-51852891-f34a-4d40-bc50-bbdb7c5f75be tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:00.170559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-51852891-f34a-4d40-bc50-bbdb7c5f75be tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:00.204537 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:00.205713 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-51852891-f34a-4d40-bc50-bbdb7c5f75be tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053629 Jan 10 12:51:00.206450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 297/622] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:51:00 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:00.214066 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:00.215598 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:00.216778 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-16ae99e3-64cc-4cc0-9fd9-cea572cc4845 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.166539 Jan 10 12:51:00.217339 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 326/623] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:00 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:00.750129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:00.750773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:00.756654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:00.757108 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:00.757891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:00.758329 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:00.894217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:00.901989 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-91c7ab23-46ba-41d9-9aa9-a402dcc88a1a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.155917 Jan 10 12:51:00.903233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 298/624] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:00 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:01.004174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-510e22fb-7633-4b58-bc6f-f964acde2802 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:01.010459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-510e22fb-7633-4b58-bc6f-f964acde2802 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.010911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-510e22fb-7633-4b58-bc6f-f964acde2802 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.071670 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-510e22fb-7633-4b58-bc6f-f964acde2802 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Going to try to stop instance {{(pid=123137) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 10 12:51:01.120015 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-510e22fb-7633-4b58-bc6f-f964acde2802 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 202 len: 0 microversion: 2.1 time: 0.119262 Jan 10 12:51:01.120660 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 327/625] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:51:00 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:51:01.129162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:01.130937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:01.139093 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.139853 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.140850 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.141783 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.219950 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e8b8f527-85b7-49fe-8a47-6d8a4c1d26b4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:01.221564 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e8b8f527-85b7-49fe-8a47-6d8a4c1d26b4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:01.229039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e8b8f527-85b7-49fe-8a47-6d8a4c1d26b4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.229806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e8b8f527-85b7-49fe-8a47-6d8a4c1d26b4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.230608 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e8b8f527-85b7-49fe-8a47-6d8a4c1d26b4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.231237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e8b8f527-85b7-49fe-8a47-6d8a4c1d26b4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.265049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e8b8f527-85b7-49fe-8a47-6d8a4c1d26b4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050300 Jan 10 12:51:01.266277 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 328/626] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:51:01 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:01.272618 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:01.273427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:01.279577 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.280322 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.281543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.282641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.310261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:01.320162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4f8e042d-4f77-42b5-a61f-e136906678ee tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.195138 Jan 10 12:51:01.320878 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 299/627] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:01 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:01.428385 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:01.437261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:01.438760 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:01.439954 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e6d92b58-593c-4525-9b65-b4b9674581e0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.172392 Jan 10 12:51:01.440514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 329/628] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:01 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:01.919951 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:01.921045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:01.927240 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.928050 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:01.929151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:01.929594 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:02.152820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:02.160423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d8484793-f247-4a78-bea2-4c576c4cb9b6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.244604 Jan 10 12:51:02.160996 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 300/629] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:01 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:02.277613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-db55cd07-fb13-4e4d-b591-eeaf08942da5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:02.279248 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-db55cd07-fb13-4e4d-b591-eeaf08942da5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:02.288130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db55cd07-fb13-4e4d-b591-eeaf08942da5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:02.288584 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db55cd07-fb13-4e4d-b591-eeaf08942da5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:02.289381 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db55cd07-fb13-4e4d-b591-eeaf08942da5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:02.289860 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db55cd07-fb13-4e4d-b591-eeaf08942da5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:02.321415 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-db55cd07-fb13-4e4d-b591-eeaf08942da5 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047644 Jan 10 12:51:02.321985 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 330/630] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:51:02 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:02.338132 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:02.338740 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:02.345804 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:02.346495 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:02.347469 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:02.347938 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:02.458050 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:02.458726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:02.464864 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:02.465314 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:02.466294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:02.466882 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:02.487140 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:02.496061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a72e345b-7658-4d34-b18d-04099ba1ae94 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.161890 Jan 10 12:51:02.496963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 301/631] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:02 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:02.609255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:02.617945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:02.619640 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:02.620868 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d7bd16ad-3674-4ec1-97ec-169d9f187332 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.166628 Jan 10 12:51:02.621430 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 331/632] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:02 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:51:03.178390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:03.179029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:03.181026 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 12:51:03.181296 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: Mon Jan 10 12:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 12:51:03.187920 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.188383 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.189383 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.189998 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.332901 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-afd3a820-7143-45e1-8797-10931b91a7ac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:03.333903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-afd3a820-7143-45e1-8797-10931b91a7ac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:03.343183 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:03.355562 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-afd3a820-7143-45e1-8797-10931b91a7ac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.356005 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-afd3a820-7143-45e1-8797-10931b91a7ac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.357115 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3d503f15-eb85-4c72-9fa4-73c4a6a2bfb8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.182517 Jan 10 12:51:03.357251 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-afd3a820-7143-45e1-8797-10931b91a7ac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.357842 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-afd3a820-7143-45e1-8797-10931b91a7ac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.358083 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 302/633] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:03 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:03.389074 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-afd3a820-7143-45e1-8797-10931b91a7ac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060376 Jan 10 12:51:03.389650 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 332/634] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:51:03 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:03.513729 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:03.514335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:03.520714 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.521270 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.522680 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.523129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.642361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:03.643560 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:03.650630 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.651253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.652227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:03.652766 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:03.659903 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:03.672429 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6bb25ac6-d097-49dd-b394-28cba2f8e49b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.162421 Jan 10 12:51:03.673267 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 303/635] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:03 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:03.801206 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:03.810212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:03.811822 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:03.812999 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c0f0f62e-3d04-4341-bcab-3dcee1ac21dd tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1806 microversion: 2.20 time: 0.174951 Jan 10 12:51:03.813558 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 333/636] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:03 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:04.375801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:04.376409 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:04.383120 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.383616 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.384573 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.385021 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.400976 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fdfdcf8a-eb71-457d-9a2f-1586a52f43f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:04.402079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fdfdcf8a-eb71-457d-9a2f-1586a52f43f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:04.408628 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fdfdcf8a-eb71-457d-9a2f-1586a52f43f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.409099 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fdfdcf8a-eb71-457d-9a2f-1586a52f43f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.415459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fdfdcf8a-eb71-457d-9a2f-1586a52f43f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.415991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fdfdcf8a-eb71-457d-9a2f-1586a52f43f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.469902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fdfdcf8a-eb71-457d-9a2f-1586a52f43f4 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072989 Jan 10 12:51:04.471189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 334/637] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:51:04 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:04.541023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:04.548357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-113deddf-5b43-4a09-b01f-8e6a708f72c2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1276 microversion: 2.1 time: 0.176262 Jan 10 12:51:04.548936 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 304/638] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:04 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:04.689997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:04.690816 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:04.697469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.698006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.698891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.699404 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.831675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:04.832383 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:04.846748 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.847255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.850137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:04.850771 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:04.851640 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:04.860000 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b6c47758-a4ca-4273-a9d9-02663a53c519 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.173645 Jan 10 12:51:04.861101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 335/639] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:04 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:05.002610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:05.012332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:05.013931 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:05.015197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b12b7d36-6ae4-4e32-a23e-55eeba4e9d63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1793 microversion: 2.20 time: 0.187862 Jan 10 12:51:05.015847 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 305/640] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:04 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1793 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:05.482980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-659f11d0-13bc-427e-8b48-13a2c034f5ca tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:05.484039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-659f11d0-13bc-427e-8b48-13a2c034f5ca tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:05.490503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-659f11d0-13bc-427e-8b48-13a2c034f5ca tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:05.490953 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-659f11d0-13bc-427e-8b48-13a2c034f5ca tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:05.491756 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-659f11d0-13bc-427e-8b48-13a2c034f5ca tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:05.492190 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-659f11d0-13bc-427e-8b48-13a2c034f5ca tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:05.522628 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-659f11d0-13bc-427e-8b48-13a2c034f5ca tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043812 Jan 10 12:51:05.523232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 336/641] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:51:05 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:51:05.577102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:05.577102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:05.577102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:05.577102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:05.577764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:05.577764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:05.745789 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:05.753764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7beddf42-c5f6-45a4-9ff0-fa6b12bef076 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.191068 Jan 10 12:51:05.754534 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 306/642] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:05 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:05.878614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:05.878614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:05.884500 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:05.884947 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:05.885869 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:05.886323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:06.035395 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:06.041640 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a16fb6d8-2a82-4462-aca5-3b3d7f7aa84c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.167654 Jan 10 12:51:06.042219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 337/643] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:05 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:06.773365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:06.773890 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:06.781419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:06.781883 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:06.782675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:06.783111 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:07.060666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:07.062150 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:07.078741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:07.079447 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:07.080443 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:07.081041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:07.145875 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:07.153889 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ae6eb7ed-9b2e-460d-8dd8-fd3ba1917e6c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.386429 Jan 10 12:51:07.155637 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 307/644] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:06 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:07.244723 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:07.253494 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bebf960e-b637-4fe7-989b-08a416b14494 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.198884 Jan 10 12:51:07.255871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 338/645] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:07 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:07.867720 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:07.868252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:07.874894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:07.875379 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:07.876828 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:07.877301 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:07.903653 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:51:07.981088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6a2b9539-472a-486f-bdb7-19bad2cb8b21 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 204 len: 0 microversion: 2.1 time: 0.116910 Jan 10 12:51:07.981692 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 308/646] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:51:07 2022] DELETE /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:51:07.990492 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:07.991098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:07.997292 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:07.997749 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:07.998542 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:07.998986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:08.135252 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:08.142914 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9b989fbc-16f7-408a-88dc-f77bdba86b7d tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1505 microversion: 2.1 time: 0.156553 Jan 10 12:51:08.143487 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 339/647] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:07 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:08.172414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:08.173107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:08.179187 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:08.179659 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:08.180413 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:08.180850 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:08.198358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:08.199031 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:08.205268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:08.205727 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:08.206511 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:08.206951 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:08.288745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lazy-loading 'services' on Instance uuid 72a3b001-2e2d-41ff-b973-ba9c612f2e57 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:51:08.327798 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:08.357559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9cbdba26-afda-445d-8603-72af3725fda6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.189178 Jan 10 12:51:08.358243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 309/648] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:08 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:08.367164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-158c0891-2b05-4f39-a765-ad64c1192592 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57/os-volume_attachments/7bd8869c-6221-4da8-81fc-689f5ccc1102" status: 202 len: 0 microversion: 2.1 time: 0.167357 Jan 10 12:51:08.367164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 340/649] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:51:08 2022] DELETE /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57/os-volume_attachments/7bd8869c-6221-4da8-81fc-689f5ccc1102 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:51:08.368004 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:08.368733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:08.374867 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:08.375323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:08.376143 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:08.376578 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:08.537118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:08.544850 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e272eb6c-9303-4ef9-ac0a-41541bff107f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.180590 Jan 10 12:51:08.545431 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 341/650] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:08 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:09.160435 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:09.161078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:09.168711 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.169173 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.169981 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.170423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.325610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:09.337532 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ed23e781-247e-4970-9aa8-85858cf1c135 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1505 microversion: 2.1 time: 0.180798 Jan 10 12:51:09.338129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 310/651] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:09 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:09.376260 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:09.376900 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:09.385248 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.385744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.386872 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.387718 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.487898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:09.488138 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:09.496832 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.497385 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.498657 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.499355 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.526700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:51:09.550965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:09.558563 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c78e49ce-4730-417b-b938-bca6756a18b5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.187344 Jan 10 12:51:09.559498 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 342/652] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:09 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:09.569130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:09.569130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:09.570658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.571099 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.571908 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.572341 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.605861 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-542052df-f79a-4c1e-9f19-f7791c46c7a1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 204 len: 0 microversion: 2.1 time: 0.121573 Jan 10 12:51:09.606872 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 311/653] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:51:09 2022] DELETE /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:51:09.616995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:09.617725 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:09.623688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.624144 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.624930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:09.625367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:09.743838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:09.752528 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a7a09085-ff03-494b-8ab1-431bb6b961af tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.191963 Jan 10 12:51:09.753131 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 343/654] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:09 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:09.786945 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:09.795210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-355b9af7-22bc-4ee2-9600-0df338824fb3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1515 microversion: 2.1 time: 0.184159 Jan 10 12:51:09.795840 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 312/655] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:09 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:10.356398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:10.357112 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:10.362971 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.363494 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.364393 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.364898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.503400 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:10.511374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-23993045-af66-4542-aee5-84a70da7cacb tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1505 microversion: 2.1 time: 0.158715 Jan 10 12:51:10.512009 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 344/656] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:10 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:10.577995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:10.578588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:10.585682 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.586132 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.586990 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.587316 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.719219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:10.727500 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5eabfda9-cadf-4d29-bc9a-fa4f7428d8f9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.153144 Jan 10 12:51:10.728930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 313/657] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:10 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:10.769805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:10.770445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:10.777118 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.777568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.778340 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.778767 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.813045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:10.814012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:10.821579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.822467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.827465 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:10.828054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:10.955907 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:10.965083 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-35230b13-9083-4d19-a469-22d310955733 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.198928 Jan 10 12:51:10.974752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 345/658] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:10 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:11.019548 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:11.027418 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-05b57cf6-54d6-4dfa-bf0b-877991544c8b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1515 microversion: 2.1 time: 0.219112 Jan 10 12:51:11.028031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 314/659] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:10 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:11.529477 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:11.530199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:11.538502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:11.539314 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:11.540288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:11.540929 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:11.687352 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:11.709120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d6886220-cb99-4a97-b0dd-9a811d1e6f45 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 200 len: 1505 microversion: 2.1 time: 0.183500 Jan 10 12:51:11.709898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 346/660] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:11 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:11.744645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:11.745239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:11.754915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:11.755366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:11.756242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:11.756860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:11.800639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-9c321afc-d1ea-44a1-8fb9-b50afea14d8e req-cc0a6bdb-dd0a-4510-9375-86acdf8e06b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7d250b-ae30-4ddc-9e68-0272505cf636", "name": "network-vif-deleted", "tag": "5f9bf9f4-13cb-4777-adde-d6b21836bdff"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:11.802924 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:11.802924 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:51:11.822852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-9c321afc-d1ea-44a1-8fb9-b50afea14d8e req-cc0a6bdb-dd0a-4510-9375-86acdf8e06b2 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:11.823783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-9c321afc-d1ea-44a1-8fb9-b50afea14d8e req-cc0a6bdb-dd0a-4510-9375-86acdf8e06b2 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:11.839709 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-9c321afc-d1ea-44a1-8fb9-b50afea14d8e req-cc0a6bdb-dd0a-4510-9375-86acdf8e06b2 service nova] Creating event network-vif-deleted:5f9bf9f4-13cb-4777-adde-d6b21836bdff for instance 7c7d250b-ae30-4ddc-9e68-0272505cf636 on hv-cinder-maste Jan 10 12:51:11.848914 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-9c321afc-d1ea-44a1-8fb9-b50afea14d8e req-cc0a6bdb-dd0a-4510-9375-86acdf8e06b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051694 Jan 10 12:51:11.849538 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 347/661] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:11.922417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:11.930276 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-405a9547-ea17-4522-853f-6e9a8e0def07 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.189190 Jan 10 12:51:11.930874 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 315/662] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:11 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:11.982921 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:11.983697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:11.990152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:11.990632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:11.991463 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:11.992136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.046464 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:12.047709 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:12.057681 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.059701 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.060770 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.061495 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.167688 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:12.176097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-65ef6837-d781-473e-b7b4-86271b117ca3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.197488 Jan 10 12:51:12.176935 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 348/663] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:11 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:12.245025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:12.254906 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1045ca0e-492d-4e19-aa52-402f8f711130 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 200 len: 1515 microversion: 2.1 time: 0.213211 Jan 10 12:51:12.257346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 316/664] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:12 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:12.726806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:12.727438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: 7c7d250b-ae30-4ddc-9e68-0272505cf636] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:12.738979 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.739919 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.741560 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.742312 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.768722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] HTTP exception thrown: Instance 7c7d250b-ae30-4ddc-9e68-0272505cf636 could not be found. Jan 10 12:51:12.769674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Returning 404 to user: Instance 7c7d250b-ae30-4ddc-9e68-0272505cf636 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:12.770703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-663fbbd0-b4ca-4cb7-8af1-df20a70745ed tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636" status: 404 len: 111 microversion: 2.1 time: 0.048031 Jan 10 12:51:12.771451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 349/665] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:12 2022] GET /compute/v2.1/servers/7c7d250b-ae30-4ddc-9e68-0272505cf636 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:51:12.780082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:12.780618 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:12.786954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.787507 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.788541 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.789140 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.823752 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:51:12.911154 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1a0af9b5-d501-4722-8cd1-73a7f6eb3aff tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 204 len: 0 microversion: 2.1 time: 0.134914 Jan 10 12:51:12.912029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 317/666] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:51:12 2022] DELETE /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:51:12.920876 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:12.921567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:12.927484 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.928129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.929051 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.929326 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.948837 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:12.949533 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:12.958364 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.958364 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:12.958364 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:12.958364 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:13.141974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:13.149870 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:13.150174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6cc564fc-5ec0-4806-a853-767c5bcd6bac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.233167 Jan 10 12:51:13.150808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 350/667] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:12 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:13.169917 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b3e0d265-c6bc-4523-9fa4-ed4034f3ab76 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.225917 Jan 10 12:51:13.179314 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 318/668] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:12 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:13.193227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:13.193902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:13.207079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:13.207553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:13.208361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:13.208816 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:13.274580 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:13.275197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: 72a3b001-2e2d-41ff-b973-ba9c612f2e57] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:13.282895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:13.283496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:13.284334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:13.285473 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:13.300542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] HTTP exception thrown: Instance 72a3b001-2e2d-41ff-b973-ba9c612f2e57 could not be found. Jan 10 12:51:13.301163 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Returning 404 to user: Instance 72a3b001-2e2d-41ff-b973-ba9c612f2e57 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:13.302178 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-50f05c52-1b02-49c8-85dd-24aec862e181 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57" status: 404 len: 111 microversion: 2.1 time: 0.031867 Jan 10 12:51:13.303288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 319/669] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:13 2022] GET /compute/v2.1/servers/72a3b001-2e2d-41ff-b973-ba9c612f2e57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:51:13.372324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:13.381742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7bbae9bb-c85c-42f8-aa5b-7b3c06a856fb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.192153 Jan 10 12:51:13.382343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 351/670] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:13 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:13.871324 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-bf056221-cb05-41e1-9d0b-656841e0ac66 req-a47f1813-2a2e-4ab4-a92e-d8f35635cd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a3b001-2e2d-41ff-b973-ba9c612f2e57", "name": "network-vif-deleted", "tag": "f8161287-bb70-4b66-8b85-92c2fa1f8702"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:13.872945 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:13.872945 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:51:13.880515 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-bf056221-cb05-41e1-9d0b-656841e0ac66 req-a47f1813-2a2e-4ab4-a92e-d8f35635cd55 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:13.880957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-bf056221-cb05-41e1-9d0b-656841e0ac66 req-a47f1813-2a2e-4ab4-a92e-d8f35635cd55 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:13.892114 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-bf056221-cb05-41e1-9d0b-656841e0ac66 req-a47f1813-2a2e-4ab4-a92e-d8f35635cd55 service nova] Creating event network-vif-deleted:f8161287-bb70-4b66-8b85-92c2fa1f8702 for instance 72a3b001-2e2d-41ff-b973-ba9c612f2e57 on hv-cinder-maste Jan 10 12:51:13.897106 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-bf056221-cb05-41e1-9d0b-656841e0ac66 req-a47f1813-2a2e-4ab4-a92e-d8f35635cd55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029435 Jan 10 12:51:13.897789 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 320/671] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:14.169998 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:14.170852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:14.179642 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:14.180096 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:14.180879 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:14.181582 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:14.186907 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:14.187638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:14.194731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:14.195218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:14.196047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:14.196483 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:14.376689 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:14.385027 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8bc1498a-fea1-4c58-9675-c9ebc472d001 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.220477 Jan 10 12:51:14.385233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:14.385612 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 352/672] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:14 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:14.392772 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c940ad5a-0eff-4a26-8830-7d994b44cafe tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.210218 Jan 10 12:51:14.393312 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 321/673] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:14 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:14.398632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:14.399231 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:14.405021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:14.405460 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:14.406240 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:14.406681 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:14.557802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:14.568740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-54c333db-2bd6-4265-b635-516be61e5347 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.173797 Jan 10 12:51:14.569449 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 353/674] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:14 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:15.405297 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:15.406032 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:15.409455 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:15.409910 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:15.412917 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:15.413365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:15.414149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:15.414578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:15.416562 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:15.417209 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:15.418144 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:15.418734 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:15.614755 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:15.620677 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:15.623301 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3754acef-4aec-4844-ad31-726f76558583 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.217753 Jan 10 12:51:15.624690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 354/675] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:15 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:15.629836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-25873702-b130-4d5a-bdcd-65d9c2e40764 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.228606 Jan 10 12:51:15.630417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 322/676] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:15 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:15.637743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:15.638353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:15.645108 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:15.645569 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:15.646355 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:15.646972 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:15.779768 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:15.787907 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a60c5550-d1b8-468d-90dc-73c81e07da0a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.162511 Jan 10 12:51:15.788490 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 355/677] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:15 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:16.649391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:16.651345 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:16.651992 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:16.653915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:16.660402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:16.660851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:16.661678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:16.662121 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:16.668171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:16.668620 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:16.669427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:16.669856 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:16.922800 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:16.926502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:16.931925 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5a2b2691-5381-441a-9d8a-677a660157de tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.292759 Jan 10 12:51:16.945226 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 323/678] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:16 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:16.945453 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-94259c04-733e-445f-8e7f-2cb27d2c7a38 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.289983 Jan 10 12:51:16.945453 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 356/679] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:16 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:16.945641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:16.945641 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:16.946671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:16.947372 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:16.948272 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:16.948831 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:17.087544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:17.093977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-74c4488d-494b-4fc2-bfc9-e81866ad1a59 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.159880 Jan 10 12:51:17.094550 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 324/680] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:16 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:17.565411 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-bc22bc0d-187c-4c8a-9aaa-61eb2059976b req-1c47a03d-2c63-48ee-8625-1b749a7d21e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508c5420-5725-4665-b594-8990cf7bc668", "name": "network-vif-plugged", "status": "completed", "tag": "b0c8664c-1be2-4aa4-ad7d-298feadd5169"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:17.567267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:17.567267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:51:17.574617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-bc22bc0d-187c-4c8a-9aaa-61eb2059976b req-1c47a03d-2c63-48ee-8625-1b749a7d21e5 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:17.575429 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-bc22bc0d-187c-4c8a-9aaa-61eb2059976b req-1c47a03d-2c63-48ee-8625-1b749a7d21e5 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:17.586944 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-bc22bc0d-187c-4c8a-9aaa-61eb2059976b req-1c47a03d-2c63-48ee-8625-1b749a7d21e5 service nova] Creating event network-vif-plugged:b0c8664c-1be2-4aa4-ad7d-298feadd5169 for instance 508c5420-5725-4665-b594-8990cf7bc668 on hv-cinder-maste Jan 10 12:51:17.591748 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-bc22bc0d-187c-4c8a-9aaa-61eb2059976b req-1c47a03d-2c63-48ee-8625-1b749a7d21e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030146 Jan 10 12:51:17.592380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 357/681] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:17.949180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:17.949778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:17.953984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:17.954718 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:17.957042 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:17.957561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:17.958471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:17.958970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:17.961471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:17.962105 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:17.963132 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:17.963780 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:18.169098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:18.174015 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:18.176765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8067e361-70b0-43e8-ad8b-2ccb153e3473 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.227582 Jan 10 12:51:18.177338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 358/682] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:17 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:18.182295 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:18.182897 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:18.189053 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:18.189693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:18.190659 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:18.191093 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:18.191791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f6ed196c-2c82-4929-b970-daa60422992a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.246644 Jan 10 12:51:18.192356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 325/683] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:17 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:18.322649 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:18.330888 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9dee3ba1-0963-4932-be4d-555f3ab34578 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.152356 Jan 10 12:51:18.331464 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 359/684] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:18 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:19.194305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:19.194869 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:19.201163 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:19.201610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:19.202462 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:19.202890 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:19.208765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:19.209664 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:19.216296 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:19.216742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:19.217732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:19.218147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:19.424313 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:19.430893 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:19.434930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-28ccbafb-c310-4df7-a806-da13c6a27017 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.244346 Jan 10 12:51:19.436270 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 326/685] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:19 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:19.447350 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f86fc2e4-97fd-4b55-93b1-393697863770 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.242565 Jan 10 12:51:19.448007 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 360/686] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:19 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:19.453039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:19.453655 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:19.460479 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:19.460863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:19.461738 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:19.462575 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:19.591496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:19.604392 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7d3abf83-d5a4-4d32-84b7-485bb8197ed9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.166856 Jan 10 12:51:19.605036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 327/687] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:19 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:20.451793 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:20.452368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:20.458949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:20.459395 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:20.460195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:20.460625 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:20.464625 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:20.465966 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:20.472756 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:20.473214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:20.474011 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:20.474448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:20.658893 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:20.667182 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3e03897a-ebc4-4a2f-b1b8-74b2d6be3a04 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1522 microversion: 2.1 time: 0.218993 Jan 10 12:51:20.668080 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 361/688] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:20 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:20.679810 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:20.681752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:20.682439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:20.688604 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-50f56eae-4ec1-4694-8052-c9dd2d0da966 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1264 microversion: 2.1 time: 0.228413 Jan 10 12:51:20.688752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:20.689259 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:20.689484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 328/689] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:20 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:20.690482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:20.691112 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:20.828933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:20.839072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ab8b837f-135b-40d6-bce0-082f08be091c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.161330 Jan 10 12:51:20.839930 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 362/690] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:20 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:21.214746 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1758081124", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "networks": [{"uuid": "5af1f618-4b76-4aff-a2a2-5ebba4d5c873"}]}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:21.271985 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] validate_networks() for [('5af1f618-4b76-4aff-a2a2-5ebba4d5c873', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:51:21.624115 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:51:21.624678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:51:21.625044 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:51:21.625493 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:51:21.626158 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:51:21.637021 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.637591 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.638421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.638929 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.657117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Getting quotas for project 36b1b002256e43eba62e736d945f9049. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:51:21.661488 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Getting quotas for user 90f35219a70d4e0596a6c28bd9ef9acc and project 36b1b002256e43eba62e736d945f9049. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:51:21.673698 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:51:21.676421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:51:21.685572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:21.687357 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:21.695160 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.695635 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.696840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.697438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.740051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f24958c4-0fe9-4f81-a825-3f169c3c4089 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530629 Jan 10 12:51:21.740936 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 329/691] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:51:21.751752 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:21.752642 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:21.764368 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.765280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.766751 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.767373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.807343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c2b5d01a124f3e94bc557b641f77a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de46aa3bf673456885b6c388c16c901b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:21.823540 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4a437511-ee25-4ac9-af0a-d8773958ebac tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 200 len: 1480 microversion: 2.1 time: 0.143022 Jan 10 12:51:21.824219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 363/692] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:21 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 1480 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:21.828597 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c651fd08-1454-4694-baea-a098ba82c251 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:21.832500 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c651fd08-1454-4694-baea-a098ba82c251 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:21.915154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c651fd08-1454-4694-baea-a098ba82c251 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:21.922745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c651fd08-1454-4694-baea-a098ba82c251 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1219 microversion: 2.1 time: 0.097347 Jan 10 12:51:21.923438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 364/693] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:21 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:21.928258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-1c391a99-b3cc-49be-9403-387d39cde54b req-5e2be64d-1b9e-4856-b636-9e1e70fb84f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e102ed1c-55c4-488a-9729-a99f58666989", "name": "network-vif-deleted", "tag": "f0859772-0161-44d0-9616-11e398c35d8b"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:21.936402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:21.936402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:51:21.946261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-1c391a99-b3cc-49be-9403-387d39cde54b req-5e2be64d-1b9e-4856-b636-9e1e70fb84f9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.947008 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-1c391a99-b3cc-49be-9403-387d39cde54b req-5e2be64d-1b9e-4856-b636-9e1e70fb84f9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.960094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-1c391a99-b3cc-49be-9403-387d39cde54b req-5e2be64d-1b9e-4856-b636-9e1e70fb84f9 service nova] Creating event network-vif-deleted:f0859772-0161-44d0-9616-11e398c35d8b for instance e102ed1c-55c4-488a-9729-a99f58666989 on hv-cinder-maste Jan 10 12:51:21.964939 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:21.965632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-1c391a99-b3cc-49be-9403-387d39cde54b req-5e2be64d-1b9e-4856-b636-9e1e70fb84f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040963 Jan 10 12:51:21.966430 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 365/694] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:21.971587 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:21.972304 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:21.973186 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d39dfb03-aa69-4d01-b18f-3afecdbca3f6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1450 microversion: 2.1 time: 0.230816 Jan 10 12:51:21.973730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 330/695] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:21 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1450 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:21.979173 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.979668 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.980475 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.980992 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.991288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:21.991933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:21.998387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:21.998841 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:21.999662 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:22.000137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:22.192361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:22.196604 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:22.203181 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a86f8168-ce7c-48a3-8e2b-63143031f019 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.235334 Jan 10 12:51:22.203974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 366/696] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:21 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:22.205298 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0a9fab25-5c4c-4ab5-aaea-c6dee06b8b36 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1450 microversion: 2.1 time: 0.217579 Jan 10 12:51:22.209894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 331/697] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:21 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1450 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:22.840885 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:22.843296 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] [instance: e102ed1c-55c4-488a-9729-a99f58666989] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:22.851483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:22.853117 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:22.855934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:22.857361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:22.892955 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] HTTP exception thrown: Instance e102ed1c-55c4-488a-9729-a99f58666989 could not be found. Jan 10 12:51:22.894068 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] Returning 404 to user: Instance e102ed1c-55c4-488a-9729-a99f58666989 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:22.894936 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-868cc234-9e72-4199-b986-58ef38b964f3 tempest-ServerRescueNegativeTestJSON-2075867396 tempest-ServerRescueNegativeTestJSON-2075867396-project] 10.222.0.13 "GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989" status: 404 len: 111 microversion: 2.1 time: 0.058408 Jan 10 12:51:22.896056 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 367/698] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:22 2022] GET /compute/v2.1/servers/e102ed1c-55c4-488a-9729-a99f58666989 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:51:22.940661 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:22.942450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:22.949374 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:22.949831 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:22.950657 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:22.951280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:23.032716 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:23.040793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c16778e5-890f-42ba-a817-8a35661c463f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1277 microversion: 2.1 time: 0.103828 Jan 10 12:51:23.041104 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 332/699] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:22 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:23.221105 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:23.221728 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:23.228010 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:23.228782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:23.229751 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:23.230367 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:23.724427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:23.749296 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bdc213af-91b1-4ec9-94c5-7b4da525cfab tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.532053 Jan 10 12:51:23.754236 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 368/700] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:23 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:51:24.057649 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:24.059746 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:24.069328 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:24.071302 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:24.073566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:24.074325 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:24.219713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-8cb9cf87-5fe9-4efb-91fd-21e18e82077b req-aa0b5490-8de6-4269-9d64-91577ac7f626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f754ca-3b81-4ac1-895b-3c6049a09cb3", "tag": "84585c51-168a-46c1-8900-8e565489be7a"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:24.222012 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:24.222012 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:51:24.230966 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-8cb9cf87-5fe9-4efb-91fd-21e18e82077b req-aa0b5490-8de6-4269-9d64-91577ac7f626 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:24.231774 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-8cb9cf87-5fe9-4efb-91fd-21e18e82077b req-aa0b5490-8de6-4269-9d64-91577ac7f626 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:24.243972 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-8cb9cf87-5fe9-4efb-91fd-21e18e82077b req-aa0b5490-8de6-4269-9d64-91577ac7f626 service nova] Creating event network-changed:84585c51-168a-46c1-8900-8e565489be7a for instance f7f754ca-3b81-4ac1-895b-3c6049a09cb3 on hv-cinder-maste Jan 10 12:51:24.248940 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-8cb9cf87-5fe9-4efb-91fd-21e18e82077b req-aa0b5490-8de6-4269-9d64-91577ac7f626 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032861 Jan 10 12:51:24.249747 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 369/701] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:24.570561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:24.578500 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-95743b62-3d01-4867-8f52-9a916711547b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.524610 Jan 10 12:51:24.579739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 333/702] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:24 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:24.767343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:24.768195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:24.775401 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:24.775870 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:24.776663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:24.777122 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:25.203233 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:25.211784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0a1c0ebf-45a4-4552-82fd-ba305886e5d2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.448820 Jan 10 12:51:25.212647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 370/703] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:24 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:25.582611 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-dd512d58-e963-4e5a-b6aa-9b00581616d7 req-0e067058-5ac4-4a78-8366-c461f03b475e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508c5420-5725-4665-b594-8990cf7bc668", "tag": "b0c8664c-1be2-4aa4-ad7d-298feadd5169"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:25.585210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:25.585210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:51:25.596427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:25.599911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:25.608456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-dd512d58-e963-4e5a-b6aa-9b00581616d7 req-0e067058-5ac4-4a78-8366-c461f03b475e service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:25.612070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:25.612587 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-dd512d58-e963-4e5a-b6aa-9b00581616d7 req-0e067058-5ac4-4a78-8366-c461f03b475e service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:25.613122 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:25.617632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:25.618759 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:25.640277 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-dd512d58-e963-4e5a-b6aa-9b00581616d7 req-0e067058-5ac4-4a78-8366-c461f03b475e service nova] Creating event network-changed:b0c8664c-1be2-4aa4-ad7d-298feadd5169 for instance 508c5420-5725-4665-b594-8990cf7bc668 on hv-cinder-maste Jan 10 12:51:25.647065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-dd512d58-e963-4e5a-b6aa-9b00581616d7 req-0e067058-5ac4-4a78-8366-c461f03b475e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070226 Jan 10 12:51:25.647721 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 334/704] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:25.915529 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:25.923722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-51df814b-5a18-4754-b01b-3c29ceaef22f tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.331451 Jan 10 12:51:25.936299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 371/705] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:25 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:26.234614 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:26.236719 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:26.253800 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:26.255333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:26.256324 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:26.259370 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:26.557150 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:26.568709 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-362f56bb-85dc-4d92-b008-f7797bd304e3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.342887 Jan 10 12:51:26.570065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 335/706] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:26 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:26.947000 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:26.948341 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:26.967369 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:26.967873 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:26.971387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:26.975157 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:27.400069 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:27.408566 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-628a64d0-e523-4825-b8e3-38a567e3baae tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.466081 Jan 10 12:51:27.409968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 372/707] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:26 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:27.592731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:27.594363 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:27.603806 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:27.604539 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:27.605567 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:27.606003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:27.777563 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:27.787656 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-36c35f3c-c4da-4def-bc91-4c9caf5ecdb2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.201466 Jan 10 12:51:27.787656 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 336/708] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:27 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:28.427722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:28.428545 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:28.435975 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:28.436500 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:28.437509 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:28.437980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:28.589216 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:28.603231 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1b5899e6-b785-4875-8cd5-d8b26c8a4a05 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.179121 Jan 10 12:51:28.604974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 373/709] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:28 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:28.802003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:28.802692 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:28.809549 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:28.810001 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:28.810800 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:28.811238 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:28.949868 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:28.958037 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9cd87325-ac7e-4adb-8325-789740ddb7f7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.159890 Jan 10 12:51:28.958622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 337/710] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:28 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:29.489384 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e7a9c398-0720-41e7-aff6-f7fd8281cac5 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Action: 'create', calling method: .version_select at 0x7f7fca73bca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1880958975"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:29.620876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:29.621475 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:29.627491 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:29.628072 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:29.629219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:29.629667 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:29.776289 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:29.784298 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1f394605-3fa4-4212-8950-a41c1d118bb4 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.167403 Jan 10 12:51:29.784951 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 338/711] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:29 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:29.790237 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-aa2ff9ea-8cc3-4881-9fc1-a8500663b5b0 req-20469dca-aaf8-413e-84e7-51c2d2aa02cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f754ca-3b81-4ac1-895b-3c6049a09cb3", "name": "network-vif-plugged", "status": "completed", "tag": "84585c51-168a-46c1-8900-8e565489be7a"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:29.792136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:29.792136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:51:29.800822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-aa2ff9ea-8cc3-4881-9fc1-a8500663b5b0 req-20469dca-aaf8-413e-84e7-51c2d2aa02cf service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:29.801569 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-aa2ff9ea-8cc3-4881-9fc1-a8500663b5b0 req-20469dca-aaf8-413e-84e7-51c2d2aa02cf service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:29.813012 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e7a9c398-0720-41e7-aff6-f7fd8281cac5 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.463030 Jan 10 12:51:29.813848 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 374/712] 10.222.0.13 () {60 vars in 1154 bytes} [Mon Jan 10 12:51:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 10 12:51:29.817822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-aa2ff9ea-8cc3-4881-9fc1-a8500663b5b0 req-20469dca-aaf8-413e-84e7-51c2d2aa02cf service nova] Creating event network-vif-plugged:84585c51-168a-46c1-8900-8e565489be7a for instance f7f754ca-3b81-4ac1-895b-3c6049a09cb3 on hv-cinder-maste Jan 10 12:51:29.824478 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-aa2ff9ea-8cc3-4881-9fc1-a8500663b5b0 req-20469dca-aaf8-413e-84e7-51c2d2aa02cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037437 Jan 10 12:51:29.826021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b7ed648d-3cac-4404-a5c9-588c2327ef87 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca864f70>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:29.828191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 339/713] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:29.877926 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b7ed648d-3cac-4404-a5c9-588c2327ef87 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595" status: 200 len: 345 microversion: 2.1 time: 0.056954 Jan 10 12:51:29.878724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 375/714] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:51:29 2022] GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:29.979417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:29.980356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:29.988112 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:29.988697 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:29.989688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:29.990185 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:30.132404 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:30.140745 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4a1f2b29-06f7-4178-b374-00bc5d76be21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.166096 Jan 10 12:51:30.141329 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 340/715] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:29 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:30.806139 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:30.808395 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:30.819180 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:30.820001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:30.821267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:30.821706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:30.891443 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-88698326-06af-4490-9fab-12b2e212a026 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca69ea60>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:30.944381 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-88698326-06af-4490-9fab-12b2e212a026 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595" status: 200 len: 346 microversion: 2.1 time: 0.056549 Jan 10 12:51:30.945034 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 341/716] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:51:30 2022] GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:30.956452 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-94d85e2f-2040-4094-b528-952133b494a7 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Action: 'create', calling method: .version_select at 0x7f7fca6eee50>, body: {"snapshot": {"volume_id": "555f615c-2258-408c-a820-776e69518595", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1155635402"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:30.960673 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:30.968915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ce7016da-9231-4f0d-ac52-f5b729ea6134 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.169812 Jan 10 12:51:30.969726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 376/717] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:30 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:31.124252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-94d85e2f-2040-4094-b528-952133b494a7 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.171232 Jan 10 12:51:31.124927 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 342/718] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Jan 10 12:51:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:31.135164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b623c68a-12b9-45cb-84c7-026657700323 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca744b80>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:31.157927 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:31.158531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:31.164443 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b623c68a-12b9-45cb-84c7-026657700323 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 287 microversion: 2.1 time: 0.033248 Jan 10 12:51:31.165186 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 377/719] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:31 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:31.170201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:31.170201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:31.170201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:31.174714 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-70bbdf4f-9e36-4dfb-8cd4-690ec1806d56 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca62ef70>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:31.179942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:31.206955 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-70bbdf4f-9e36-4dfb-8cd4-690ec1806d56 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035643 Jan 10 12:51:31.207823 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 378/720] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jan 10 12:51:31 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:31.218044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2e7f795a-ccee-4082-b78a-a04bebf4a4c8 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca683ee0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:31.250380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2e7f795a-ccee-4082-b78a-a04bebf4a4c8 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 287 microversion: 2.1 time: 0.035845 Jan 10 12:51:31.250956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 379/721] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:31 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:31.328422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:31.339457 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-72834445-c159-4d84-baf4-a76c9b74cf24 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.185127 Jan 10 12:51:31.340080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 343/722] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:31 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:31.989014 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:31.989648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:31.997190 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:31.997604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:31.998391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:31.998826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:32.130841 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:32.138693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4c2e5ad3-9b31-4ce8-ba70-29aa93d0627b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.155444 Jan 10 12:51:32.139235 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 380/723] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:31 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:32.266990 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0655b58c-5ac3-4552-9139-780b39a2e501 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca69e4c0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:32.307143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0655b58c-5ac3-4552-9139-780b39a2e501 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 287 microversion: 2.1 time: 0.046073 Jan 10 12:51:32.308114 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 344/724] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:32 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:32.359416 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:32.360233 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:32.369509 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:32.370071 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:32.371310 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:32.371993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:32.504684 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:32.513117 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-04cb6784-a6a9-46f9-a18e-f068427374a6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1723 microversion: 2.1 time: 0.159133 Jan 10 12:51:32.513705 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 381/725] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:32 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:33.155312 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:33.155964 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:33.162467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:33.162911 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:33.163737 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:33.164179 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:33.306942 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:33.319003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e38dbe38-820d-4be6-b10b-a3801cd4ddab tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.167242 Jan 10 12:51:33.319918 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 345/726] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:33 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:33.324053 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ad15b70a-8d89-4016-9927-35ec8b8f4149 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca61b5e0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:33.353512 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ad15b70a-8d89-4016-9927-35ec8b8f4149 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 287 microversion: 2.1 time: 0.034108 Jan 10 12:51:33.357676 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 382/727] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:33 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:33.533675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:33.534524 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:33.547427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:33.548553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:33.550359 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:33.551098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:33.692871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:33.705022 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-55993bf6-592c-414c-add8-c3120048aa3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1700 microversion: 2.1 time: 0.177391 Jan 10 12:51:33.705906 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 346/728] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:33 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1700 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:33.723908 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b76d5935-ddee-4118-9c59-b05f076924e5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:33.731470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b76d5935-ddee-4118-9c59-b05f076924e5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:33.731944 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b76d5935-ddee-4118-9c59-b05f076924e5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:33.756025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b76d5935-ddee-4118-9c59-b05f076924e5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Going to try to start instance {{(pid=123137) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 10 12:51:33.799840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b76d5935-ddee-4118-9c59-b05f076924e5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 202 len: 0 microversion: 2.1 time: 0.079355 Jan 10 12:51:33.800411 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 383/729] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:51:33 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:51:33.809643 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:33.810323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:33.818687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:33.819399 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:33.820675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:33.821367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:33.955718 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:33.967140 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c276b20d-07ca-476a-8f06-0346fca38b55 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1709 microversion: 2.1 time: 0.161482 Jan 10 12:51:33.967938 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 347/730] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:33 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:34.337017 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:34.338452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:34.344500 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:34.344928 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:34.345715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:34.346145 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:34.365802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-adf81a98-15bc-4ea5-ab0c-2f05afaeeac7 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca6ce430>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:34.398864 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-adf81a98-15bc-4ea5-ab0c-2f05afaeeac7 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 287 microversion: 2.1 time: 0.036959 Jan 10 12:51:34.399617 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 348/731] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:34 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:34.488170 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:34.497744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ca349eaa-517d-43c5-b64e-61bd134c31f1 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.165359 Jan 10 12:51:34.498291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 384/732] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:34 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:34.989975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:34.990714 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:34.998049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:34.998505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:34.999293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:34.999775 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:35.134706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:35.142971 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-451435fa-4828-49ca-9d40-ba1c662f3fc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1709 microversion: 2.1 time: 0.159034 Jan 10 12:51:35.143554 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 349/733] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:34 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:35.414853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-79844eb8-1bcb-444d-ab53-079045fbb73f tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca8345e0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:35.445634 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-79844eb8-1bcb-444d-ab53-079045fbb73f tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 287 microversion: 2.1 time: 0.036445 Jan 10 12:51:35.446196 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 385/734] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:35 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:35.518137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:35.519203 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:35.529870 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:35.530634 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:35.532004 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:35.532727 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:35.672688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:35.680395 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c6829d4a-7022-4dfa-8dbe-8c555ea8ca04 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1319 microversion: 2.1 time: 0.168496 Jan 10 12:51:35.681078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 350/735] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:35 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:36.160598 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:36.161739 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:36.170304 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:36.171225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:36.172683 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:36.173459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:36.342028 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:36.350586 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-448d31f8-ef56-486c-8ca4-6366411afff4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1709 microversion: 2.1 time: 0.193864 Jan 10 12:51:36.351375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 386/736] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:36 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1709 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:36.457914 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6148f976-4396-486c-841c-55489d5e6e29 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca6b33a0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:36.486628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6148f976-4396-486c-841c-55489d5e6e29 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 288 microversion: 2.1 time: 0.032745 Jan 10 12:51:36.487198 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 351/737] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:36 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:36.497314 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8af6e146-1850-46d4-a8b4-c1d76de70b19 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca864f70>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:36.553166 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8af6e146-1850-46d4-a8b4-c1d76de70b19 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 202 len: 0 microversion: 2.1 time: 0.059104 Jan 10 12:51:36.553997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 387/738] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Jan 10 12:51:36 2022] DELETE /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:51:36.562585 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-923d04fa-7037-42b0-bee0-ac89fd262dcb tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fcb174ee0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:36.592072 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-923d04fa-7037-42b0-bee0-ac89fd262dcb tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 200 len: 287 microversion: 2.1 time: 0.034242 Jan 10 12:51:36.592668 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 352/739] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:36 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:36.698620 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:36.699338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:36.705821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:36.706275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:36.707060 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:36.707498 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:36.846589 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:36.854439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-90e7c9e0-d450-4b3b-8ab7-51cbfde7e1e3 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1508 microversion: 2.1 time: 0.160267 Jan 10 12:51:36.855160 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 388/740] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:36 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:36.871129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4def9701-9762-405b-aef5-735088f508b2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "610f6f69-caeb-4336-998d-4679f2aabfc3", "device": "/dev/sdb"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:36.872970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4def9701-9762-405b-aef5-735088f508b2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:36.879790 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4def9701-9762-405b-aef5-735088f508b2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:36.880249 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4def9701-9762-405b-aef5-735088f508b2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:36.881038 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4def9701-9762-405b-aef5-735088f508b2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:36.881477 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4def9701-9762-405b-aef5-735088f508b2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:37.148956 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4def9701-9762-405b-aef5-735088f508b2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "POST /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281538 Jan 10 12:51:37.149638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 353/741] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:51:36 2022] POST /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:51:37.368213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:37.368726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:37.375771 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:37.376226 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:37.377021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:37.377458 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:37.519865 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:37.531767 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1877dd23-c60a-4a64-845a-98e914b42576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1713 microversion: 2.1 time: 0.167098 Jan 10 12:51:37.532820 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 389/742] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:51:37 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:37.607667 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4c129aef-eb21-49f4-a130-4bf7ea9a88e5 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca69e310>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:37.632537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-4c129aef-eb21-49f4-a130-4bf7ea9a88e5 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] HTTP exception thrown: Snapshot c315ddf8-e0c0-43cd-8505-bb17cf09a740 could not be found. Jan 10 12:51:37.633194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4c129aef-eb21-49f4-a130-4bf7ea9a88e5 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Returning 404 to user: Snapshot c315ddf8-e0c0-43cd-8505-bb17cf09a740 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:37.634402 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4c129aef-eb21-49f4-a130-4bf7ea9a88e5 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740" status: 404 len: 111 microversion: 2.1 time: 0.033042 Jan 10 12:51:37.634968 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 354/743] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jan 10 12:51:37 2022] GET /compute/v2.1/os-snapshots/c315ddf8-e0c0-43cd-8505-bb17cf09a740 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:51:37.643879 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1e7cdc34-eba4-4c91-bc5e-3f35aec6fb03 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca744c10>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:37.706179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1e7cdc34-eba4-4c91-bc5e-3f35aec6fb03 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595" status: 202 len: 0 microversion: 2.1 time: 0.065905 Jan 10 12:51:37.706708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 390/744] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jan 10 12:51:37 2022] DELETE /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:51:37.715117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b13329d4-28ee-4b15-b536-0816d1fb7511 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca6b3e50>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:37.763342 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b13329d4-28ee-4b15-b536-0816d1fb7511 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595" status: 200 len: 345 microversion: 2.1 time: 0.052008 Jan 10 12:51:37.764025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 355/745] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:51:37 2022] GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:38.776832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-445590a0-319d-41ea-97a0-b1353f811953 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca834160>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:38.804150 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-445590a0-319d-41ea-97a0-b1353f811953 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] HTTP exception thrown: Volume 555f615c-2258-408c-a820-776e69518595 could not be found. Jan 10 12:51:38.804694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-445590a0-319d-41ea-97a0-b1353f811953 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Returning 404 to user: Volume 555f615c-2258-408c-a820-776e69518595 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:38.805553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-445590a0-319d-41ea-97a0-b1353f811953 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595" status: 404 len: 109 microversion: 2.1 time: 0.033231 Jan 10 12:51:38.806099 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 391/746] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:51:38 2022] GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:51:38.821078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8183decd-8f0b-44be-a87b-3b0ecf8c2fee tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fca6aeee0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:38.849260 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-8183decd-8f0b-44be-a87b-3b0ecf8c2fee tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] HTTP exception thrown: Volume 555f615c-2258-408c-a820-776e69518595 could not be found. Jan 10 12:51:38.849865 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8183decd-8f0b-44be-a87b-3b0ecf8c2fee tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Returning 404 to user: Volume 555f615c-2258-408c-a820-776e69518595 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:38.850702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8183decd-8f0b-44be-a87b-3b0ecf8c2fee tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595" status: 404 len: 109 microversion: 2.1 time: 0.033885 Jan 10 12:51:38.851271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 356/747] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jan 10 12:51:38 2022] DELETE /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:51:38.860098 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a6727d77-f4b1-49c6-8a32-dd5911c7de13 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Calling method '.version_select at 0x7f7fcce6a700>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:38.886649 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-a6727d77-f4b1-49c6-8a32-dd5911c7de13 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] HTTP exception thrown: Volume 555f615c-2258-408c-a820-776e69518595 could not be found. Jan 10 12:51:38.887345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a6727d77-f4b1-49c6-8a32-dd5911c7de13 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] Returning 404 to user: Volume 555f615c-2258-408c-a820-776e69518595 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:38.888228 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a6727d77-f4b1-49c6-8a32-dd5911c7de13 tempest-VolumesSnapshotsTestJSON-2050354658 tempest-VolumesSnapshotsTestJSON-2050354658-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595" status: 404 len: 109 microversion: 2.1 time: 0.031749 Jan 10 12:51:38.888762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 392/748] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:51:38 2022] GET /compute/v2.1/os-volumes/555f615c-2258-408c-a820-776e69518595 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:51:47.196333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-611b8d8e-23a3-48d3-80ad-6513c394ed29 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:47.197205 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-611b8d8e-23a3-48d3-80ad-6513c394ed29 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:47.204782 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-611b8d8e-23a3-48d3-80ad-6513c394ed29 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:47.205220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-611b8d8e-23a3-48d3-80ad-6513c394ed29 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:47.206080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-611b8d8e-23a3-48d3-80ad-6513c394ed29 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:47.206494 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-611b8d8e-23a3-48d3-80ad-6513c394ed29 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:47.237651 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-611b8d8e-23a3-48d3-80ad-6513c394ed29 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments/14f2bcac-84eb-4e09-b5bf-6713e45632b8" status: 200 len: 194 microversion: 2.20 time: 0.047602 Jan 10 12:51:47.238234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 357/749] 10.222.0.13 () {60 vars in 1453 bytes} [Mon Jan 10 12:51:47 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments/14f2bcac-84eb-4e09-b5bf-6713e45632b8 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:51:47.301705 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:47.302307 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:47.310440 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:47.310946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:47.311765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:47.312203 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:47.387647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lazy-loading 'services' on Instance uuid 3436ba09-022f-4b36-987d-667c236d68d1 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:51:47.467689 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-44017876-0831-471a-b422-c04b36057855 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments/14f2bcac-84eb-4e09-b5bf-6713e45632b8" status: 202 len: 0 microversion: 2.20 time: 0.170794 Jan 10 12:51:47.468203 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 393/750] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jan 10 12:51:47 2022] DELETE /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments/14f2bcac-84eb-4e09-b5bf-6713e45632b8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:51:47.476476 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9883db86-550f-4e1a-8949-abf62b0b53b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:47.477486 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9883db86-550f-4e1a-8949-abf62b0b53b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:47.483827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9883db86-550f-4e1a-8949-abf62b0b53b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:47.484083 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9883db86-550f-4e1a-8949-abf62b0b53b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:47.484893 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9883db86-550f-4e1a-8949-abf62b0b53b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:47.485334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9883db86-550f-4e1a-8949-abf62b0b53b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:47.516080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9883db86-550f-4e1a-8949-abf62b0b53b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043325 Jan 10 12:51:47.516662 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 358/751] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jan 10 12:51:47 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:51:48.529610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-07326a97-63db-41e1-a95c-785efebcd789 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:48.530936 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-07326a97-63db-41e1-a95c-785efebcd789 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:48.537769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07326a97-63db-41e1-a95c-785efebcd789 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:48.538303 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07326a97-63db-41e1-a95c-785efebcd789 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:48.539147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07326a97-63db-41e1-a95c-785efebcd789 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:48.539673 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-07326a97-63db-41e1-a95c-785efebcd789 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:48.570682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-07326a97-63db-41e1-a95c-785efebcd789 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046212 Jan 10 12:51:48.572672 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 394/752] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jan 10 12:51:48 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:51:49.587915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-94c1c70f-bd4b-44ea-9c96-1bb815ed94e2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:49.589365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-94c1c70f-bd4b-44ea-9c96-1bb815ed94e2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:49.600911 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94c1c70f-bd4b-44ea-9c96-1bb815ed94e2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:49.601649 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94c1c70f-bd4b-44ea-9c96-1bb815ed94e2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:49.602928 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94c1c70f-bd4b-44ea-9c96-1bb815ed94e2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:49.603681 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-94c1c70f-bd4b-44ea-9c96-1bb815ed94e2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:49.635200 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-94c1c70f-bd4b-44ea-9c96-1bb815ed94e2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053683 Jan 10 12:51:49.635787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 359/753] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jan 10 12:51:49 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:51:50.646618 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9bdd71ec-3cf4-43ac-8b8c-d1d3cee7177e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:50.647541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9bdd71ec-3cf4-43ac-8b8c-d1d3cee7177e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:50.654169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdd71ec-3cf4-43ac-8b8c-d1d3cee7177e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:50.654658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdd71ec-3cf4-43ac-8b8c-d1d3cee7177e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:50.655433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdd71ec-3cf4-43ac-8b8c-d1d3cee7177e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:50.656054 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9bdd71ec-3cf4-43ac-8b8c-d1d3cee7177e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:50.687025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9bdd71ec-3cf4-43ac-8b8c-d1d3cee7177e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Jan 10 12:51:50.687808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 395/754] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jan 10 12:51:50 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:51:51.703507 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d62f1937-7072-41b6-9de0-3a47037ea599 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:51.704429 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d62f1937-7072-41b6-9de0-3a47037ea599 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:51.711050 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d62f1937-7072-41b6-9de0-3a47037ea599 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:51.711498 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d62f1937-7072-41b6-9de0-3a47037ea599 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:51.712308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d62f1937-7072-41b6-9de0-3a47037ea599 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:51.712723 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d62f1937-7072-41b6-9de0-3a47037ea599 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:51.742234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d62f1937-7072-41b6-9de0-3a47037ea599 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045209 Jan 10 12:51:51.742844 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 360/755] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jan 10 12:51:51 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:51:51.806339 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:51.807130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:51.818134 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:51.818840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:51.820164 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:51.820875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:51.849041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Going to try to terminate instance {{(pid=123137) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:51:51.931071 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0fa7a2a9-dc17-409b-bc4e-648d6793350c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 204 len: 0 microversion: 2.20 time: 0.130565 Jan 10 12:51:51.931893 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 396/756] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jan 10 12:51:51 2022] DELETE /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 10 12:51:51.940502 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:51.941452 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:51.948447 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:51.949060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:51.950255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:51.950841 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:52.110874 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:52.123005 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:52.125358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:52.126725 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e1170462-48bb-4739-a500-1b09951e7ac5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.190285 Jan 10 12:51:52.127288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 361/757] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:51 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:53.147742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:53.148525 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:53.156133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:53.156669 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:53.157570 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:53.158080 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:53.298228 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:53.306732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:53.308267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:53.309783 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-61ff320b-6735-4d95-a922-4b06c84e39b5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.166834 Jan 10 12:51:53.310390 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 397/758] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:53 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:54.328324 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:54.329331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:54.335560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:54.336041 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:54.336829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:54.337259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:54.474811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:54.483744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:54.485287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:54.486663 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e60e05e8-a4dc-45f8-8cb7-2be25ebbf64b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.162334 Jan 10 12:51:54.487220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 362/759] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:54 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:55.509207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:55.510445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:55.519505 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:55.520057 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:55.520769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:55.521208 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:55.660695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:55.669055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:55.670561 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:55.671772 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-03677112-83e2-4706-8301-cb136b6b69bf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.169234 Jan 10 12:51:55.672343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 398/760] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:55 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:56.693012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:56.694298 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:56.701498 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:56.702206 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:56.703248 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:56.703833 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:56.940290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:56.954161 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:56.957953 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:51:56.960295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bf46b1a3-6194-4cea-b04d-fe862d516c8d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 200 len: 1721 microversion: 2.20 time: 0.273344 Jan 10 12:51:56.962356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 363/761] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:56 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:51:57.349776 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-28607484-da92-4ae6-aae9-fee3d9db81de req-6ffb84df-535a-49af-b0c5-5ff62c38a6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3436ba09-022f-4b36-987d-667c236d68d1", "name": "network-vif-deleted", "tag": "0341fd05-df0a-4b20-a713-82457a146a1c"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:57.352019 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:51:57.352019 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:51:57.361827 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-28607484-da92-4ae6-aae9-fee3d9db81de req-6ffb84df-535a-49af-b0c5-5ff62c38a6f3 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:57.362665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-28607484-da92-4ae6-aae9-fee3d9db81de req-6ffb84df-535a-49af-b0c5-5ff62c38a6f3 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:57.377099 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-28607484-da92-4ae6-aae9-fee3d9db81de req-6ffb84df-535a-49af-b0c5-5ff62c38a6f3 service nova] Creating event network-vif-deleted:0341fd05-df0a-4b20-a713-82457a146a1c for instance 3436ba09-022f-4b36-987d-667c236d68d1 on hv-cinder-maste Jan 10 12:51:57.382915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-28607484-da92-4ae6-aae9-fee3d9db81de req-6ffb84df-535a-49af-b0c5-5ff62c38a6f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037048 Jan 10 12:51:57.384732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 399/762] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:51:57.980834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:57.982174 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:57.990484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:57.991242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:57.992279 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:57.992885 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:58.009078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] HTTP exception thrown: Instance 3436ba09-022f-4b36-987d-667c236d68d1 could not be found. Jan 10 12:51:58.009970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Returning 404 to user: Instance 3436ba09-022f-4b36-987d-667c236d68d1 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:51:58.010985 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-62d38773-92f0-4dac-90cf-15b1f4e7cf5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 404 len: 111 microversion: 2.20 time: 0.034069 Jan 10 12:51:58.011780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 364/763] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:51:57 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:51:58.021591 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ee673226-1054-4b7c-bf8f-9b28a7da1cd1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '.version_select at 0x7f7fca68e1f0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:58.050617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ee673226-1054-4b7c-bf8f-9b28a7da1cd1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931598735" status: 204 len: 0 microversion: 2.20 time: 0.033792 Jan 10 12:51:58.055573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 400/764] 10.222.0.13 () {60 vars in 1258 bytes} [Mon Jan 10 12:51:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931598735 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 10 12:51:58.719651 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:51:58.720733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:51:58.728069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:58.728776 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:58.729768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:51:58.730513 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:51:58.827784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lazy-loading 'services' on Instance uuid f7f754ca-3b81-4ac1-895b-3c6049a09cb3 {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:51:58.858568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a545bbd9-695e-45ac-a941-25f9c0276df5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'create', calling method: .version_select at 0x7f7fca6dd550>, body: {"keypair": {"name": "tempest-keypair-345082850"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:51:58.873566 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-a545bbd9-695e-45ac-a941-25f9c0276df5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:51:58.877466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-a545bbd9-695e-45ac-a941-25f9c0276df5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for user 8c5ac449d0494ab585c0aeccb9541016 and project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:51:58.900185 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4231ebda-4f63-4047-9cf9-52b5a6c2f3ba tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3/os-volume_attachments/610f6f69-caeb-4336-998d-4679f2aabfc3" status: 202 len: 0 microversion: 2.1 time: 0.184626 Jan 10 12:51:58.901590 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 365/765] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:51:58 2022] DELETE /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3/os-volume_attachments/610f6f69-caeb-4336-998d-4679f2aabfc3 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:51:59.325347 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-a545bbd9-695e-45ac-a941-25f9c0276df5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:51:59.329360 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-a545bbd9-695e-45ac-a941-25f9c0276df5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for user 8c5ac449d0494ab585c0aeccb9541016 and project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:51:59.342607 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a545bbd9-695e-45ac-a941-25f9c0276df5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.489649 Jan 10 12:51:59.343202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 401/766] 10.222.0.13 () {62 vars in 1198 bytes} [Mon Jan 10 12:51:58 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 491 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 10 12:52:00.035499 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:00.036275 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:00.045783 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:00.047051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:00.048135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:00.048913 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:00.077622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:52:00.175940 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-05dd9f1c-c3e2-43e1-be1f-5d134ea14612 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 204 len: 0 microversion: 2.1 time: 0.144353 Jan 10 12:52:00.180146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 366/767] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:52:00 2022] DELETE /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:52:00.185912 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:00.186662 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:00.193313 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:00.193991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:00.194954 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:00.195581 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:00.339852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:00.348212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f7b531d2-c39b-435c-a70d-7f052cb3815b tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1514 microversion: 2.1 time: 0.166752 Jan 10 12:52:00.348803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 402/768] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:00 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:00.863091 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-370692027", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4e2bf48-1c7a-42e2-945e-96cdb90a357a"}], "security_groups": [{"name": "tempest-securitygroup--1160814753"}], "key_name": "tempest-keypair-345082850", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:00.966708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] validate_networks() for [('e4e2bf48-1c7a-42e2-945e-96cdb90a357a', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:52:01.359315 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:52:01.360017 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:52:01.360332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:52:01.360742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:52:01.361157 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:52:01.366671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:01.367254 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:01.370052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:01.370508 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:01.371323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:01.371793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:01.373603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:01.374052 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:01.374844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:01.375267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:01.389509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:52:01.395551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Getting quotas for user 8c5ac449d0494ab585c0aeccb9541016 and project 4be23531f9014bfebfd2d51c8502d6ce. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:52:01.407505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:52:01.410026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:52:01.460847 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f52664bc-9000-4721-aa14-c9dcf96f382e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.602769 Jan 10 12:52:01.462049 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 367/769] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jan 10 12:52:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 10 12:52:01.472155 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-02588b89-38ab-4f12-90c1-5b44a0ec7a25 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:01.472766 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-02588b89-38ab-4f12-90c1-5b44a0ec7a25 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:01.536206 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:01.540194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-02588b89-38ab-4f12-90c1-5b44a0ec7a25 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:01.543853 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ea4aea19-47f9-496f-acb4-3487d1bebdf2 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1514 microversion: 2.1 time: 0.181733 Jan 10 12:52:01.544687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 403/770] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:01 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:52:01.548841 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-02588b89-38ab-4f12-90c1-5b44a0ec7a25 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:01.550348 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-02588b89-38ab-4f12-90c1-5b44a0ec7a25 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:01.551460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-02588b89-38ab-4f12-90c1-5b44a0ec7a25 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1280 microversion: 2.20 time: 0.083822 Jan 10 12:52:01.552201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 368/771] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:01 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:52:02.564519 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:02.564519 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:02.570152 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:02.571822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:02.583387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:02.584140 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:02.585675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:02.588502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:02.593191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:02.593564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:02.594358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:02.595025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:02.670406 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:02.679221 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:02.680854 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:02.682063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cb953a18-7dba-4dca-96ac-7d92d67e69f5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1338 microversion: 2.20 time: 0.115948 Jan 10 12:52:02.682703 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 369/772] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:02 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1338 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:52:02.691006 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-ccee64d7-cddf-48cf-976f-cdfb9ac85557 req-254371aa-0052-429f-901f-417e94e41a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f754ca-3b81-4ac1-895b-3c6049a09cb3", "name": "network-vif-deleted", "tag": "84585c51-168a-46c1-8900-8e565489be7a"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:02.692715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:52:02.692715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:52:02.696683 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f35219a70d4e0596a6c28bd9ef9acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36b1b002256e43eba62e736d945f9049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:02.704533 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0913dc51-5118-4234-a2be-f77b2f655eb9 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 200 len: 1472 microversion: 2.1 time: 0.146259 Jan 10 12:52:02.705224 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 404/773] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:02 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 1472 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:02.712047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-ccee64d7-cddf-48cf-976f-cdfb9ac85557 req-254371aa-0052-429f-901f-417e94e41a87 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:02.712047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-ccee64d7-cddf-48cf-976f-cdfb9ac85557 req-254371aa-0052-429f-901f-417e94e41a87 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:02.721944 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-ccee64d7-cddf-48cf-976f-cdfb9ac85557 req-254371aa-0052-429f-901f-417e94e41a87 service nova] Creating event network-vif-deleted:84585c51-168a-46c1-8900-8e565489be7a for instance f7f754ca-3b81-4ac1-895b-3c6049a09cb3 on hv-cinder-maste Jan 10 12:52:02.727246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-ccee64d7-cddf-48cf-976f-cdfb9ac85557 req-254371aa-0052-429f-901f-417e94e41a87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043108 Jan 10 12:52:02.727861 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 370/774] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:52:03.701189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:03.701817 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:03.709370 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:03.709823 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:03.710646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:03.711084 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:03.723871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:03.724645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] [instance: f7f754ca-3b81-4ac1-895b-3c6049a09cb3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:03.731374 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:03.731845 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:03.732622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:03.735061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:03.749993 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] HTTP exception thrown: Instance f7f754ca-3b81-4ac1-895b-3c6049a09cb3 could not be found. Jan 10 12:52:03.750586 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] Returning 404 to user: Instance f7f754ca-3b81-4ac1-895b-3c6049a09cb3 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:52:03.752177 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c4bc0522-0bd0-41fc-945c-3e82ee66ad25 tempest-VolumesSnapshotTestJSON-1600223418 tempest-VolumesSnapshotTestJSON-1600223418-project] 10.222.0.13 "GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3" status: 404 len: 111 microversion: 2.1 time: 0.033300 Jan 10 12:52:03.756136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 371/775] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:03 2022] GET /compute/v2.1/servers/f7f754ca-3b81-4ac1-895b-3c6049a09cb3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:52:03.861906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:03.870377 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:03.872254 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:03.873377 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9517b5de-44bb-469d-a861-45708d78c3a1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.176018 Jan 10 12:52:03.873946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 405/776] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:03 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:04.746894 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-948daea6-0145-4965-b625-13408a9eb1dc req-63410b92-408c-44e3-815b-c0e62649d8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09225d89-9a27-4364-a81c-ed60792c76f3", "tag": "dc3f0c02-667c-403b-91d3-b98ae7eeec12"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:04.748635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:52:04.748635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:52:04.757947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-948daea6-0145-4965-b625-13408a9eb1dc req-63410b92-408c-44e3-815b-c0e62649d8fb service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:04.758796 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-948daea6-0145-4965-b625-13408a9eb1dc req-63410b92-408c-44e3-815b-c0e62649d8fb service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:04.772433 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-948daea6-0145-4965-b625-13408a9eb1dc req-63410b92-408c-44e3-815b-c0e62649d8fb service nova] Creating event network-changed:dc3f0c02-667c-403b-91d3-b98ae7eeec12 for instance 09225d89-9a27-4364-a81c-ed60792c76f3 on hv-cinder-maste Jan 10 12:52:04.777975 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-948daea6-0145-4965-b625-13408a9eb1dc req-63410b92-408c-44e3-815b-c0e62649d8fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034761 Jan 10 12:52:04.778575 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 372/777] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:52:04.892416 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:04.893051 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:04.899811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:04.900264 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:04.901045 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:04.901483 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:05.030028 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:05.038178 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:05.039748 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:05.040844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ba7cd0b5-b6d4-4bf7-b6c6-f8be72a670af tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.152511 Jan 10 12:52:05.041377 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 406/778] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:04 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:06.064210 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:06.065271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:06.076036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:06.076778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:06.078044 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:06.078759 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:06.222083 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:06.230888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:06.232423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:06.233535 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4b3c59e9-9e7b-456c-9372-6d803997573e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.176771 Jan 10 12:52:06.234104 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 373/779] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:06 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:07.252622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:07.253294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:07.261553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:07.262002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:07.262832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:07.263196 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:07.405239 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:07.414283 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:07.415802 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:07.416905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6ecd7096-96a7-4a01-8d19-8640160a19ec tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.169261 Jan 10 12:52:07.417479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 407/780] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:07 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:08.435537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:08.436106 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:08.443199 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:08.443760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:08.444551 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:08.444959 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:08.599791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:08.604312 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:08.606188 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:08.607421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4ee4ea0b-b92c-405d-880c-389fbe119807 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.176091 Jan 10 12:52:08.608746 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 374/781] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:08 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:09.633702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:09.634253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:09.643811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:09.644258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:09.645045 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:09.645476 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:09.793505 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:09.802043 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:09.803553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:09.804697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-935505e2-3b76-4024-96aa-c119ade900e5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.175819 Jan 10 12:52:09.805268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 408/782] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:09 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:10.826269 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:10.827267 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:10.842522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:10.842522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:10.842522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:10.842522 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:10.976362 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:10.984529 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:10.986052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:10.987387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5ef1e2cb-9689-4abf-aa39-6f9a33e2d21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.167493 Jan 10 12:52:10.988025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 375/783] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:10 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:12.009487 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:12.010409 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:12.020059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:12.020510 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:12.021314 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:12.021750 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:12.159432 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:12.167893 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:12.169435 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:12.170562 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-393e31ec-b052-4be9-9d72-752b80dcb413 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.167450 Jan 10 12:52:12.171127 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 409/784] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:12 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:13.193799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:13.194878 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:13.205636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:13.206097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:13.206876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:13.207308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:13.358695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:13.370930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:13.373261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:13.374764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-78d829a9-659e-4805-8df8-0cc9017a93e4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.188239 Jan 10 12:52:13.375505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 376/785] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:13 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:14.393316 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:14.394132 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:14.400446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:14.400866 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:14.401672 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:14.402079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:14.538006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:14.545893 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:14.547541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:14.548875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cf9f9927-abc4-4efd-9665-331305a36950 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.159232 Jan 10 12:52:14.549443 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 410/786] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:14 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:15.570117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:15.570815 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:15.579044 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:15.579647 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:15.580622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:15.581166 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:15.729989 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:15.738499 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:15.740207 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:15.741433 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c61287da-23f2-40e3-8d25-af0e1c436e3f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.176701 Jan 10 12:52:15.742442 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 377/787] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:15 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:16.189377 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-eec29f04-3990-486c-b008-260a4e836d21 req-bf88c6dd-c34e-4ddc-8373-693ad2b7aa10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09225d89-9a27-4364-a81c-ed60792c76f3", "name": "network-vif-plugged", "status": "completed", "tag": "dc3f0c02-667c-403b-91d3-b98ae7eeec12"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:16.191213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:52:16.191213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:52:16.200884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-eec29f04-3990-486c-b008-260a4e836d21 req-bf88c6dd-c34e-4ddc-8373-693ad2b7aa10 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:16.201272 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-eec29f04-3990-486c-b008-260a4e836d21 req-bf88c6dd-c34e-4ddc-8373-693ad2b7aa10 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:16.212896 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-eec29f04-3990-486c-b008-260a4e836d21 req-bf88c6dd-c34e-4ddc-8373-693ad2b7aa10 service nova] Creating event network-vif-plugged:dc3f0c02-667c-403b-91d3-b98ae7eeec12 for instance 09225d89-9a27-4364-a81c-ed60792c76f3 on hv-cinder-maste Jan 10 12:52:16.218108 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-eec29f04-3990-486c-b008-260a4e836d21 req-bf88c6dd-c34e-4ddc-8373-693ad2b7aa10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034436 Jan 10 12:52:16.219073 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 411/788] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:52:16.762662 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:16.763281 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:16.770197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:16.770546 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:16.771331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:16.771803 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:16.913237 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:16.921169 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:16.922677 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:16.923817 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7dc1bded-287a-4a2d-9a07-639b3fdf9803 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1406 microversion: 2.20 time: 0.165117 Jan 10 12:52:16.924393 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 378/789] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:16 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:17.946444 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:17.947174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:17.954119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:17.954579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:17.955356 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:17.955825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:18.106639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:18.115789 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:18.118007 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:18.119747 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-67ba5440-beba-403b-bfe8-a4f872e90aa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1598 microversion: 2.20 time: 0.178221 Jan 10 12:52:18.120295 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 412/790] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:52:17 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:52:18.139743 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7499937e-fa80-43c5-8e66-0cb5d18b4d6e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:18.140295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7499937e-fa80-43c5-8e66-0cb5d18b4d6e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:18.148842 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7499937e-fa80-43c5-8e66-0cb5d18b4d6e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:18.149292 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7499937e-fa80-43c5-8e66-0cb5d18b4d6e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:18.150074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7499937e-fa80-43c5-8e66-0cb5d18b4d6e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:18.150511 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7499937e-fa80-43c5-8e66-0cb5d18b4d6e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:18.229403 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7499937e-fa80-43c5-8e66-0cb5d18b4d6e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095256 Jan 10 12:52:18.230238 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 379/791] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jan 10 12:52:18 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:52:19.371442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-01cbdb86-5a3e-475c-a5ea-fa8d1be523ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:19.372433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-01cbdb86-5a3e-475c-a5ea-fa8d1be523ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:19.373795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-08830860-ce58-46a5-b45f-48b583f312b9 req-3f8c28e5-db1b-4b38-aadf-e3ea5b5a6b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09225d89-9a27-4364-a81c-ed60792c76f3", "tag": "dc3f0c02-667c-403b-91d3-b98ae7eeec12"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:19.375381 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:52:19.375381 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:52:19.379436 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-01cbdb86-5a3e-475c-a5ea-fa8d1be523ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:19.379947 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-01cbdb86-5a3e-475c-a5ea-fa8d1be523ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:19.380714 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-01cbdb86-5a3e-475c-a5ea-fa8d1be523ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:19.381149 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-01cbdb86-5a3e-475c-a5ea-fa8d1be523ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:19.383856 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-08830860-ce58-46a5-b45f-48b583f312b9 req-3f8c28e5-db1b-4b38-aadf-e3ea5b5a6b1c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:19.385577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-08830860-ce58-46a5-b45f-48b583f312b9 req-3f8c28e5-db1b-4b38-aadf-e3ea5b5a6b1c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:19.396253 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-08830860-ce58-46a5-b45f-48b583f312b9 req-3f8c28e5-db1b-4b38-aadf-e3ea5b5a6b1c service nova] Creating event network-changed:dc3f0c02-667c-403b-91d3-b98ae7eeec12 for instance 09225d89-9a27-4364-a81c-ed60792c76f3 on hv-cinder-maste Jan 10 12:52:19.401390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-08830860-ce58-46a5-b45f-48b583f312b9 req-3f8c28e5-db1b-4b38-aadf-e3ea5b5a6b1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032077 Jan 10 12:52:19.402596 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 380/792] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:52:20.486370 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-01cbdb86-5a3e-475c-a5ea-fa8d1be523ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14 microversion: 2.20 time: 1.118273 Jan 10 12:52:20.487231 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 413/793] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:19 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:21.499098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-35a8ec22-f66e-4e9d-a1bf-c4699195a5c9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:21.500142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-35a8ec22-f66e-4e9d-a1bf-c4699195a5c9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:21.506830 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35a8ec22-f66e-4e9d-a1bf-c4699195a5c9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:21.507294 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35a8ec22-f66e-4e9d-a1bf-c4699195a5c9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:21.508114 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35a8ec22-f66e-4e9d-a1bf-c4699195a5c9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:21.508563 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-35a8ec22-f66e-4e9d-a1bf-c4699195a5c9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:24.022957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-35a8ec22-f66e-4e9d-a1bf-c4699195a5c9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14 microversion: 2.20 time: 2.527709 Jan 10 12:52:24.024007 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 381/794] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:21 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:25.041656 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-348cf50c-3379-4683-8083-8ed0347d148f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:25.043280 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-348cf50c-3379-4683-8083-8ed0347d148f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:25.054070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-348cf50c-3379-4683-8083-8ed0347d148f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:25.054522 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-348cf50c-3379-4683-8083-8ed0347d148f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:25.055297 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-348cf50c-3379-4683-8083-8ed0347d148f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:25.055764 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-348cf50c-3379-4683-8083-8ed0347d148f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:25.119738 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-348cf50c-3379-4683-8083-8ed0347d148f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14 microversion: 2.20 time: 0.085296 Jan 10 12:52:25.120658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 414/795] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:25 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:26.134661 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f9a0eb3e-5796-401f-9ba4-942a19824dc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:26.135711 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f9a0eb3e-5796-401f-9ba4-942a19824dc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:26.142836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a0eb3e-5796-401f-9ba4-942a19824dc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:26.143282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a0eb3e-5796-401f-9ba4-942a19824dc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:26.144187 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a0eb3e-5796-401f-9ba4-942a19824dc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:26.144691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f9a0eb3e-5796-401f-9ba4-942a19824dc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:26.206414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f9a0eb3e-5796-401f-9ba4-942a19824dc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14 microversion: 2.20 time: 0.077342 Jan 10 12:52:26.207505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 382/796] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:26 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:27.217985 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-baf4ed31-5cc3-4101-943b-1ab2fa6a55d7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:27.219125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-baf4ed31-5cc3-4101-943b-1ab2fa6a55d7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:27.228760 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-baf4ed31-5cc3-4101-943b-1ab2fa6a55d7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:27.229211 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-baf4ed31-5cc3-4101-943b-1ab2fa6a55d7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:27.229992 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-baf4ed31-5cc3-4101-943b-1ab2fa6a55d7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:27.230502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-baf4ed31-5cc3-4101-943b-1ab2fa6a55d7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:27.291217 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-baf4ed31-5cc3-4101-943b-1ab2fa6a55d7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14 microversion: 2.20 time: 0.077169 Jan 10 12:52:27.291898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 415/797] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:27 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:28.303361 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-01f1ee88-666e-484c-83f0-b2b895ca8c6c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:28.304313 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-01f1ee88-666e-484c-83f0-b2b895ca8c6c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:28.311687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01f1ee88-666e-484c-83f0-b2b895ca8c6c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:28.312150 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01f1ee88-666e-484c-83f0-b2b895ca8c6c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:28.312930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01f1ee88-666e-484c-83f0-b2b895ca8c6c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:28.313371 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01f1ee88-666e-484c-83f0-b2b895ca8c6c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:28.377654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-01f1ee88-666e-484c-83f0-b2b895ca8c6c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14 microversion: 2.20 time: 0.078434 Jan 10 12:52:28.381172 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 383/798] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:28 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:29.389022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-02e6c1af-ad7a-4463-b65f-fc95c586365e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:29.390037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-02e6c1af-ad7a-4463-b65f-fc95c586365e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:29.397241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-02e6c1af-ad7a-4463-b65f-fc95c586365e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:29.397837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-02e6c1af-ad7a-4463-b65f-fc95c586365e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:29.398633 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-02e6c1af-ad7a-4463-b65f-fc95c586365e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:29.399063 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-02e6c1af-ad7a-4463-b65f-fc95c586365e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:29.466464 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-02e6c1af-ad7a-4463-b65f-fc95c586365e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14 microversion: 2.20 time: 0.081419 Jan 10 12:52:29.467442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 416/799] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:29 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:30.477851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-01b1aa2e-d712-44f4-804c-9a7737422d31 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:30.478985 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-01b1aa2e-d712-44f4-804c-9a7737422d31 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:30.485799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01b1aa2e-d712-44f4-804c-9a7737422d31 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:30.486243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01b1aa2e-d712-44f4-804c-9a7737422d31 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:30.487023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01b1aa2e-d712-44f4-804c-9a7737422d31 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:30.487456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01b1aa2e-d712-44f4-804c-9a7737422d31 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:30.566903 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-01b1aa2e-d712-44f4-804c-9a7737422d31 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 6068 microversion: 2.20 time: 0.092796 Jan 10 12:52:30.567649 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 384/800] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:30 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 6068 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:52:31.578932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0a5360a5-c428-4148-b0ba-328549a25bcf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:31.579992 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0a5360a5-c428-4148-b0ba-328549a25bcf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:31.588837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a5360a5-c428-4148-b0ba-328549a25bcf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:31.589291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a5360a5-c428-4148-b0ba-328549a25bcf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:31.590108 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a5360a5-c428-4148-b0ba-328549a25bcf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:31.590574 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a5360a5-c428-4148-b0ba-328549a25bcf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:31.665734 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0a5360a5-c428-4148-b0ba-328549a25bcf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 14483 microversion: 2.20 time: 0.090789 Jan 10 12:52:31.667332 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 417/801] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:31 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 14483 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:32.679249 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a0644a62-1d36-4d40-b6b5-2061f0f06c5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:32.680344 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a0644a62-1d36-4d40-b6b5-2061f0f06c5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:32.688704 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0644a62-1d36-4d40-b6b5-2061f0f06c5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:32.689272 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0644a62-1d36-4d40-b6b5-2061f0f06c5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:32.690063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0644a62-1d36-4d40-b6b5-2061f0f06c5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:32.690490 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0644a62-1d36-4d40-b6b5-2061f0f06c5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:32.763900 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a0644a62-1d36-4d40-b6b5-2061f0f06c5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 18356 microversion: 2.20 time: 0.089058 Jan 10 12:52:32.764612 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 385/802] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:32 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 18356 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:33.776357 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f7c2e9f5-f38e-403c-aaaa-fc37a07a073c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:33.777374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f7c2e9f5-f38e-403c-aaaa-fc37a07a073c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:33.786829 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7c2e9f5-f38e-403c-aaaa-fc37a07a073c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:33.786829 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7c2e9f5-f38e-403c-aaaa-fc37a07a073c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:33.786829 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7c2e9f5-f38e-403c-aaaa-fc37a07a073c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:33.786829 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f7c2e9f5-f38e-403c-aaaa-fc37a07a073c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:33.858285 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f7c2e9f5-f38e-403c-aaaa-fc37a07a073c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 19342 microversion: 2.20 time: 0.085955 Jan 10 12:52:33.859149 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 418/803] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:33 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 19342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:34.871843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3c0f8d93-cd57-40b4-a9bd-7e5781e48635 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:34.872872 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3c0f8d93-cd57-40b4-a9bd-7e5781e48635 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:34.880214 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c0f8d93-cd57-40b4-a9bd-7e5781e48635 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:34.880908 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c0f8d93-cd57-40b4-a9bd-7e5781e48635 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:34.882073 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c0f8d93-cd57-40b4-a9bd-7e5781e48635 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:34.882760 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c0f8d93-cd57-40b4-a9bd-7e5781e48635 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:34.954497 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3c0f8d93-cd57-40b4-a9bd-7e5781e48635 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 22021 microversion: 2.20 time: 0.087072 Jan 10 12:52:34.955253 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 386/804] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:34 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 22021 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:35.971608 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f8158c1a-d178-426c-b715-112e40f1024b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:35.973283 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f8158c1a-d178-426c-b715-112e40f1024b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:35.981730 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8158c1a-d178-426c-b715-112e40f1024b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:35.982187 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8158c1a-d178-426c-b715-112e40f1024b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:35.982974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8158c1a-d178-426c-b715-112e40f1024b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:35.983422 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f8158c1a-d178-426c-b715-112e40f1024b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:36.012307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:36.012899 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:36.021819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:36.022296 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:36.023179 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:36.023902 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:36.064330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f8158c1a-d178-426c-b715-112e40f1024b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 23441 microversion: 2.20 time: 0.099137 Jan 10 12:52:36.066349 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 419/805] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:35 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 23441 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:36.220513 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lazy-loading 'services' on Instance uuid d04a2f28-f535-468a-ba8b-39cdc590147b {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:52:36.295356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-af7fe368-c243-4d35-8886-0da357aacc87 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-volume_attachments/8170bf09-57f7-4922-aa3c-fc18c7b2b155" status: 202 len: 0 microversion: 2.1 time: 0.287189 Jan 10 12:52:36.296164 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 387/806] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:52:36 2022] DELETE /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-volume_attachments/8170bf09-57f7-4922-aa3c-fc18c7b2b155 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:37.076779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-749d239c-e327-48eb-b74e-7b4c339cc5c3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:37.077671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-749d239c-e327-48eb-b74e-7b4c339cc5c3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:37.087777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-749d239c-e327-48eb-b74e-7b4c339cc5c3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:37.088222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-749d239c-e327-48eb-b74e-7b4c339cc5c3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:37.089020 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-749d239c-e327-48eb-b74e-7b4c339cc5c3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:37.089462 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-749d239c-e327-48eb-b74e-7b4c339cc5c3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:39.405676 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-749d239c-e327-48eb-b74e-7b4c339cc5c3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 27505 microversion: 2.20 time: 2.332770 Jan 10 12:52:39.406860 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 420/807] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:37 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 27505 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:40.419809 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2dacdc1c-9e9f-4e00-b56a-e29fd9e06246 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:40.421566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2dacdc1c-9e9f-4e00-b56a-e29fd9e06246 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:40.428602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2dacdc1c-9e9f-4e00-b56a-e29fd9e06246 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:40.429060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2dacdc1c-9e9f-4e00-b56a-e29fd9e06246 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:40.430061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2dacdc1c-9e9f-4e00-b56a-e29fd9e06246 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:40.430508 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2dacdc1c-9e9f-4e00-b56a-e29fd9e06246 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:40.516091 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2dacdc1c-9e9f-4e00-b56a-e29fd9e06246 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 27982 microversion: 2.20 time: 0.100859 Jan 10 12:52:40.516820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 388/808] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:40 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 27982 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:40.574486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-efac5b21-c4d3-4705-9573-f35ed73b0f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:40.582179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-efac5b21-c4d3-4705-9573-f35ed73b0f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:40.582658 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-efac5b21-c4d3-4705-9573-f35ed73b0f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:40.605819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-efac5b21-c4d3-4705-9573-f35ed73b0f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Going to try to stop instance {{(pid=123137) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 10 12:52:40.662077 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-efac5b21-c4d3-4705-9573-f35ed73b0f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 202 len: 0 microversion: 2.1 time: 0.092136 Jan 10 12:52:40.663230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 421/809] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:52:40 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:40.671237 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:40.672263 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:40.681437 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:40.681881 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:40.683644 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:40.684166 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:40.879739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:40.892224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-27f52da4-1791-45bc-94a7-604f0f576f3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.225019 Jan 10 12:52:40.902791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 389/810] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:40 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:41.530879 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0682e4d2-691b-4f90-910a-57326573f24a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:41.532472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0682e4d2-691b-4f90-910a-57326573f24a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:41.546100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0682e4d2-691b-4f90-910a-57326573f24a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:41.546953 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0682e4d2-691b-4f90-910a-57326573f24a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:41.547962 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0682e4d2-691b-4f90-910a-57326573f24a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:41.548856 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0682e4d2-691b-4f90-910a-57326573f24a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:41.633412 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0682e4d2-691b-4f90-910a-57326573f24a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 28169 microversion: 2.20 time: 0.108009 Jan 10 12:52:41.635847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 422/811] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:41 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 28169 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:41.910087 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:41.911252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:41.919579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:41.920264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:41.921276 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:41.921920 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:42.185672 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:42.201577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-65d74b9b-51dd-485d-b438-8564fe797f31 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.295083 Jan 10 12:52:42.202793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 390/812] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:41 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:42.971236 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4714f1be-54ca-4f4c-a9bb-796ea5e40aa0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:42.972427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4714f1be-54ca-4f4c-a9bb-796ea5e40aa0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:42.985797 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4714f1be-54ca-4f4c-a9bb-796ea5e40aa0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:42.986403 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4714f1be-54ca-4f4c-a9bb-796ea5e40aa0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:42.987438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4714f1be-54ca-4f4c-a9bb-796ea5e40aa0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:42.988204 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4714f1be-54ca-4f4c-a9bb-796ea5e40aa0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:43.093993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4714f1be-54ca-4f4c-a9bb-796ea5e40aa0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 28169 microversion: 2.20 time: 0.451271 Jan 10 12:52:43.097335 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 423/813] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:42 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 28169 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:43.219638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:43.221135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:43.229385 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:43.230288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:43.232129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:43.233028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:43.382043 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:43.394295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fbb249ed-05e3-4cb9-b202-41b537592675 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.178413 Jan 10 12:52:43.395508 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 391/814] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:43 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:44.109755 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6728e8f0-9e4a-47fb-b2c6-dae6fb3df9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:44.111734 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6728e8f0-9e4a-47fb-b2c6-dae6fb3df9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:44.119861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6728e8f0-9e4a-47fb-b2c6-dae6fb3df9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:44.120582 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6728e8f0-9e4a-47fb-b2c6-dae6fb3df9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:44.121368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6728e8f0-9e4a-47fb-b2c6-dae6fb3df9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:44.124192 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6728e8f0-9e4a-47fb-b2c6-dae6fb3df9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:44.218979 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6728e8f0-9e4a-47fb-b2c6-dae6fb3df9f0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 28460 microversion: 2.20 time: 0.113636 Jan 10 12:52:44.220125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 424/815] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:44 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 28460 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:44.415631 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:44.416339 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:44.423430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:44.423915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:44.425010 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:44.425457 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:44.740978 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:44.749705 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-650095f6-1d2e-4c5c-b1ce-4d269501354e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.341201 Jan 10 12:52:44.751255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 392/816] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:44 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:45.233994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7e061ebb-5f59-4435-8fc1-4b0334623937 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:45.235025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7e061ebb-5f59-4435-8fc1-4b0334623937 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:45.249959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e061ebb-5f59-4435-8fc1-4b0334623937 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:45.250417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e061ebb-5f59-4435-8fc1-4b0334623937 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:45.251221 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e061ebb-5f59-4435-8fc1-4b0334623937 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:45.251694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7e061ebb-5f59-4435-8fc1-4b0334623937 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:45.373204 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7e061ebb-5f59-4435-8fc1-4b0334623937 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 28628 microversion: 2.20 time: 0.145695 Jan 10 12:52:45.377083 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 425/817] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:45 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 28628 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:45.770036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:45.770738 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:45.777491 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:45.778020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:45.779205 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:45.779979 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:45.981090 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:45.989887 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-dd643b1d-3271-4bcb-9fce-e90466dc31d1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.225351 Jan 10 12:52:46.001314 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 393/818] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:45 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:46.385884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a8e18bd5-7c3c-49bd-a64f-becc40b42bc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:46.387024 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a8e18bd5-7c3c-49bd-a64f-becc40b42bc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:46.394357 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8e18bd5-7c3c-49bd-a64f-becc40b42bc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:46.395083 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8e18bd5-7c3c-49bd-a64f-becc40b42bc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:46.396250 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8e18bd5-7c3c-49bd-a64f-becc40b42bc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:46.396838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a8e18bd5-7c3c-49bd-a64f-becc40b42bc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:46.470246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a8e18bd5-7c3c-49bd-a64f-becc40b42bc5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 28628 microversion: 2.20 time: 0.088811 Jan 10 12:52:46.471451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 426/819] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:46 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 28628 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:47.008076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:47.009335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:47.016023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:47.016695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:47.017698 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:47.018292 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:47.194135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:47.202947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-34254818-c0ce-4474-98c1-14e705701619 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.199144 Jan 10 12:52:47.204159 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 394/820] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:47 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:47.483393 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c784036b-5127-40ca-9188-cae94eba9ce4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:47.484776 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c784036b-5127-40ca-9188-cae94eba9ce4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:47.492548 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c784036b-5127-40ca-9188-cae94eba9ce4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:47.493115 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c784036b-5127-40ca-9188-cae94eba9ce4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:47.494007 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c784036b-5127-40ca-9188-cae94eba9ce4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:47.494534 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c784036b-5127-40ca-9188-cae94eba9ce4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:47.559887 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c784036b-5127-40ca-9188-cae94eba9ce4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 28628 microversion: 2.20 time: 0.080382 Jan 10 12:52:47.560628 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 427/821] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:47 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 28628 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:48.223179 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:48.223954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:48.231895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:48.232682 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:48.233775 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:48.234444 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:48.395999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:48.404298 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-854e641b-cdf0-4d25-aa48-7aff598f4576 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.187509 Jan 10 12:52:48.405145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 395/822] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:48 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:48.573135 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1b79e456-48d8-4b17-b9c8-6a7bc951b48e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:48.574803 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1b79e456-48d8-4b17-b9c8-6a7bc951b48e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:48.582237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b79e456-48d8-4b17-b9c8-6a7bc951b48e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:48.582690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b79e456-48d8-4b17-b9c8-6a7bc951b48e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:48.583486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b79e456-48d8-4b17-b9c8-6a7bc951b48e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:48.583956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b79e456-48d8-4b17-b9c8-6a7bc951b48e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:48.651794 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1b79e456-48d8-4b17-b9c8-6a7bc951b48e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 28628 microversion: 2.20 time: 0.082995 Jan 10 12:52:48.652442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 428/823] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:48 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 28628 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:49.421622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:49.422176 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:49.431106 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:49.431742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:49.432716 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:49.433817 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:49.648471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:49.656306 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3769f889-2437-4bc6-b172-d34248ad3289 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.238481 Jan 10 12:52:49.659019 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 396/824] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:49 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:52:49.664398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-541abe03-f6a1-4920-af8c-1f75368fa3ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:49.666255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-541abe03-f6a1-4920-af8c-1f75368fa3ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:49.689591 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-541abe03-f6a1-4920-af8c-1f75368fa3ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:49.690469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-541abe03-f6a1-4920-af8c-1f75368fa3ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:49.691502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-541abe03-f6a1-4920-af8c-1f75368fa3ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:49.692131 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-541abe03-f6a1-4920-af8c-1f75368fa3ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:49.800703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-541abe03-f6a1-4920-af8c-1f75368fa3ea tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 30745 microversion: 2.20 time: 0.140298 Jan 10 12:52:49.802115 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 429/825] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:49 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 30745 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:52:50.674141 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:50.674755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:50.681636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:50.682348 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:50.683705 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:50.684430 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:50.814016 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6b2c7b96-2dff-4f93-9c40-423665c037b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:50.815030 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6b2c7b96-2dff-4f93-9c40-423665c037b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:50.825187 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b2c7b96-2dff-4f93-9c40-423665c037b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:50.825598 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b2c7b96-2dff-4f93-9c40-423665c037b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:50.826398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b2c7b96-2dff-4f93-9c40-423665c037b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:50.826831 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6b2c7b96-2dff-4f93-9c40-423665c037b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:50.855575 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:50.863630 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7b746121-2c88-4b83-981f-d2b1d3cdec19 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.193183 Jan 10 12:52:50.867755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 397/826] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:50 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:52:50.926861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6b2c7b96-2dff-4f93-9c40-423665c037b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 32667 microversion: 2.20 time: 0.116694 Jan 10 12:52:50.932420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 430/827] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:50 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 32667 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:51.881759 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:51.882375 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:51.894211 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:51.895197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:51.896189 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:51.896897 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:51.943143 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d3ed6fd0-d7cf-4fef-9ef7-15bc0711b66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:51.944537 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d3ed6fd0-d7cf-4fef-9ef7-15bc0711b66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:51.957998 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d3ed6fd0-d7cf-4fef-9ef7-15bc0711b66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:51.958727 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d3ed6fd0-d7cf-4fef-9ef7-15bc0711b66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:51.960166 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d3ed6fd0-d7cf-4fef-9ef7-15bc0711b66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:51.965621 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d3ed6fd0-d7cf-4fef-9ef7-15bc0711b66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:52.060571 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d3ed6fd0-d7cf-4fef-9ef7-15bc0711b66b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 33685 microversion: 2.20 time: 0.123448 Jan 10 12:52:52.062367 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 431/828] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:51 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 33685 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:52:52.063111 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:52.071468 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-76a284fa-e765-46b0-a9ba-bb5e3a30b035 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.194269 Jan 10 12:52:52.072545 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 398/829] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:51 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:53.074587 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6e556be6-d1d9-4c6f-838e-c2bae83d7909 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:53.081208 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6e556be6-d1d9-4c6f-838e-c2bae83d7909 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:53.094207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e556be6-d1d9-4c6f-838e-c2bae83d7909 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:53.094670 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e556be6-d1d9-4c6f-838e-c2bae83d7909 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:53.095183 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:53.095693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e556be6-d1d9-4c6f-838e-c2bae83d7909 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:53.095945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6e556be6-d1d9-4c6f-838e-c2bae83d7909 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:53.096707 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:53.110171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:53.113148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:53.114232 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:53.114875 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:53.201843 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6e556be6-d1d9-4c6f-838e-c2bae83d7909 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 34959 microversion: 2.20 time: 0.132735 Jan 10 12:52:53.206379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 432/830] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:53 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 34959 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:53.318578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:53.328054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c9e85f43-98f3-447e-a5c1-1343b67500d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.238581 Jan 10 12:52:53.329180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 399/831] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:53 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:52:54.214920 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a4576477-8f55-4ff0-93b0-3c1bc5fc7e9a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:54.216634 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a4576477-8f55-4ff0-93b0-3c1bc5fc7e9a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:54.224031 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a4576477-8f55-4ff0-93b0-3c1bc5fc7e9a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:54.224518 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a4576477-8f55-4ff0-93b0-3c1bc5fc7e9a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:54.225347 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a4576477-8f55-4ff0-93b0-3c1bc5fc7e9a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:54.225949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a4576477-8f55-4ff0-93b0-3c1bc5fc7e9a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:54.298396 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a4576477-8f55-4ff0-93b0-3c1bc5fc7e9a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 36318 microversion: 2.20 time: 0.087482 Jan 10 12:52:54.299049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 433/832] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:54 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 36318 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:54.347909 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:54.348655 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:54.356397 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:54.357080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:54.358100 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:54.358756 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:54.513071 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:54.521758 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7ab4d7f9-c1a8-4bf4-9245-d4b7bdff3de7 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.179913 Jan 10 12:52:54.523357 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 400/833] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:54 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:55.311387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-160b1b53-0542-4156-b19d-a4e0e80f5c06 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:55.312621 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-160b1b53-0542-4156-b19d-a4e0e80f5c06 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:55.319964 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160b1b53-0542-4156-b19d-a4e0e80f5c06 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:55.320533 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160b1b53-0542-4156-b19d-a4e0e80f5c06 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:55.321528 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160b1b53-0542-4156-b19d-a4e0e80f5c06 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:55.322350 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160b1b53-0542-4156-b19d-a4e0e80f5c06 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:55.394448 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-160b1b53-0542-4156-b19d-a4e0e80f5c06 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 37949 microversion: 2.20 time: 0.087433 Jan 10 12:52:55.395119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 434/834] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:55 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 37949 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:52:55.539245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:55.541752 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:55.548545 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:55.549291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:55.550346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:55.550843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:55.691419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:55.699254 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f82859c1-b8af-479e-b909-a26f16e7aa32 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1677 microversion: 2.1 time: 0.164081 Jan 10 12:52:55.708801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 401/835] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:55 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:56.407502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-74b784c6-a520-4e54-9933-5aa39d59643a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:56.408708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-74b784c6-a520-4e54-9933-5aa39d59643a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:56.416550 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-74b784c6-a520-4e54-9933-5aa39d59643a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:56.417227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-74b784c6-a520-4e54-9933-5aa39d59643a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:56.418110 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-74b784c6-a520-4e54-9933-5aa39d59643a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:56.418631 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-74b784c6-a520-4e54-9933-5aa39d59643a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:56.497354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-74b784c6-a520-4e54-9933-5aa39d59643a tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 38182 microversion: 2.20 time: 0.093874 Jan 10 12:52:56.499049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 435/836] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:56 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 38182 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:56.717717 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:56.718545 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:56.726142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:56.726829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:56.727671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:56.730739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:56.873991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:56.882645 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-162a1477-bdc0-4f23-a036-7996154375cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1654 microversion: 2.1 time: 0.169047 Jan 10 12:52:56.883243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 402/837] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:56 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:56.902066 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b0eb8f69-071d-4d17-a27a-9c617685248b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:56.909197 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0eb8f69-071d-4d17-a27a-9c617685248b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:56.909846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b0eb8f69-071d-4d17-a27a-9c617685248b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:56.942722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b0eb8f69-071d-4d17-a27a-9c617685248b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Going to try to start instance {{(pid=123137) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 10 12:52:56.999206 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b0eb8f69-071d-4d17-a27a-9c617685248b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action" status: 202 len: 0 microversion: 2.1 time: 0.101393 Jan 10 12:52:56.999856 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 436/838] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:52:56 2022] POST /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:52:57.008397 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:57.009363 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:57.017972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:57.018488 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:57.019414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:57.019868 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:57.183972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:57.191630 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2d26eefa-3162-4358-99c8-a0194d532af9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1663 microversion: 2.1 time: 0.187465 Jan 10 12:52:57.195627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 403/839] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:57 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1663 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:57.511065 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8fea4fd8-bf61-4adc-9913-7214a645497e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:57.512492 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8fea4fd8-bf61-4adc-9913-7214a645497e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:57.524755 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8fea4fd8-bf61-4adc-9913-7214a645497e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:57.525199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8fea4fd8-bf61-4adc-9913-7214a645497e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:57.526049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8fea4fd8-bf61-4adc-9913-7214a645497e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:57.526490 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8fea4fd8-bf61-4adc-9913-7214a645497e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:57.594613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8fea4fd8-bf61-4adc-9913-7214a645497e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 38182 microversion: 2.20 time: 0.088038 Jan 10 12:52:57.600234 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 437/840] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:57 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 38182 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:52:58.208563 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:58.209209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:58.215666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:58.216126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:58.216909 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:58.217346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:58.361371 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:58.370224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-42a48e9e-2f58-4a18-a3a9-9a3685b33daa tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1663 microversion: 2.1 time: 0.165347 Jan 10 12:52:58.370961 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 404/841] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:58 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:58.408285 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-84660a74-37c5-4aa3-b0eb-1410e886830f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Action: 'create', calling method: .version_select at 0x7f7fca61b310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2063002998"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:58.423724 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-84660a74-37c5-4aa3-b0eb-1410e886830f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Getting quotas for project 49b93adb02f6421e98d26e140bc17634. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:52:58.427484 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-84660a74-37c5-4aa3-b0eb-1410e886830f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Getting quotas for user 0bd08123ff9041c099577fd755b432fe and project 49b93adb02f6421e98d26e140bc17634. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:52:58.514646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-84660a74-37c5-4aa3-b0eb-1410e886830f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Getting quotas for project 49b93adb02f6421e98d26e140bc17634. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:52:58.518453 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-84660a74-37c5-4aa3-b0eb-1410e886830f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Getting quotas for user 0bd08123ff9041c099577fd755b432fe and project 49b93adb02f6421e98d26e140bc17634. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:52:58.532140 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-84660a74-37c5-4aa3-b0eb-1410e886830f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.128126 Jan 10 12:52:58.532768 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 438/842] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Jan 10 12:52:58 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:52:58.583623 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-992589413", "imageRef": "48cb463a-707f-4b46-8aba-c16e72d47f13", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2063002998", "networks": [{"uuid": "4c108bf3-bb1f-41a1-a32a-859339cf2781"}]}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:58.608188 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-59914113-7981-4d87-8cc0-4f19ef0163eb tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:58.609376 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-59914113-7981-4d87-8cc0-4f19ef0163eb tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:58.615769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59914113-7981-4d87-8cc0-4f19ef0163eb tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:58.616232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59914113-7981-4d87-8cc0-4f19ef0163eb tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:58.617025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59914113-7981-4d87-8cc0-4f19ef0163eb tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:58.617482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-59914113-7981-4d87-8cc0-4f19ef0163eb tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:58.635470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] validate_networks() for [('4c108bf3-bb1f-41a1-a32a-859339cf2781', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:52:58.678625 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-59914113-7981-4d87-8cc0-4f19ef0163eb tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 38182 microversion: 2.20 time: 0.074497 Jan 10 12:52:58.679293 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 439/843] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:58 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 38182 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:52:59.048826 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:52:59.049308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:52:59.049727 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:52:59.050136 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:52:59.050544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:52:59.060858 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:59.061302 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:59.062109 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:59.062544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:59.079219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Getting quotas for project 49b93adb02f6421e98d26e140bc17634. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:52:59.083331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Getting quotas for user 0bd08123ff9041c099577fd755b432fe and project 49b93adb02f6421e98d26e140bc17634. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:52:59.094544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:52:59.096808 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48cb463a-707f-4b46-8aba-c16e72d47f13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:52:59.144744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-79d7550b-29fe-4984-b7c1-01fd7ed2b7c8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564878 Jan 10 12:52:59.145391 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 405/844] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:52:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:52:59.156151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-744a77cd-96db-4a2c-b933-460649e7388b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:59.156854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-744a77cd-96db-4a2c-b933-460649e7388b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:59.324927 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-744a77cd-96db-4a2c-b933-460649e7388b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:59.331669 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-744a77cd-96db-4a2c-b933-460649e7388b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1258 microversion: 2.1 time: 0.179531 Jan 10 12:52:59.332276 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 440/845] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:59 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:59.389294 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:52:59.389911 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:59.396827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:59.397359 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:59.398239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:59.398667 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:59.538700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:52:59.546402 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b32a4aac-9694-4d42-904c-29a608b1b06a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1667 microversion: 2.1 time: 0.161313 Jan 10 12:52:59.546972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 406/846] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:52:59 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:52:59.690420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c3d06282-d732-423c-8d06-76b209b63bc3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:52:59.691541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c3d06282-d732-423c-8d06-76b209b63bc3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:52:59.698459 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c3d06282-d732-423c-8d06-76b209b63bc3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:59.698991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c3d06282-d732-423c-8d06-76b209b63bc3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:59.699874 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c3d06282-d732-423c-8d06-76b209b63bc3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:52:59.700393 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c3d06282-d732-423c-8d06-76b209b63bc3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:52:59.781179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c3d06282-d732-423c-8d06-76b209b63bc3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 38260 microversion: 2.20 time: 0.094340 Jan 10 12:52:59.781861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 441/847] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:52:59 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 38260 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:53:00.348808 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:00.349650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:00.356095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:00.358871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:00.359848 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:00.360245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:00.419844 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:00.428273 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f72a158a-bdaf-415b-9064-d243bbd1a23d tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1316 microversion: 2.1 time: 0.083234 Jan 10 12:53:00.429087 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 407/848] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:00 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1316 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:00.794772 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8c297aa5-9713-4039-9865-dc9d991a1e5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:00.795948 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8c297aa5-9713-4039-9865-dc9d991a1e5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:00.812815 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c297aa5-9713-4039-9865-dc9d991a1e5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:00.813274 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c297aa5-9713-4039-9865-dc9d991a1e5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:00.822325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c297aa5-9713-4039-9865-dc9d991a1e5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:00.823613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8c297aa5-9713-4039-9865-dc9d991a1e5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:01.446220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:01.447818 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:01.454379 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:01.455135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:01.455979 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:01.456429 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:01.606598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:01.614333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6a5ca398-7c26-4dc0-8821-2387454b7c69 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.172212 Jan 10 12:53:01.614915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 408/849] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:01 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:02.632628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:02.633346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:02.640099 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:02.640638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:02.641497 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:02.642003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:02.787847 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:02.800954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0993ae8e-bda7-4dbd-ade4-180ea83c0997 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.172456 Jan 10 12:53:02.813137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 409/850] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:02 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:03.821119 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:03.821993 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:03.828346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:03.829103 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:03.829558 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:03.830013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:03.969306 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:03.977586 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a0882d1d-23c1-4db3-aa16-372006d93417 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.162949 Jan 10 12:53:03.978196 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 410/851] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:03 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:04.995375 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:04.996096 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:05.002529 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:05.002997 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:05.003837 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:05.004274 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:05.152182 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:05.159847 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5bc12bb8-1820-48ad-bcea-97c0161e664b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.169278 Jan 10 12:53:05.160628 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 411/852] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:04 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:06.176721 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:06.177447 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:06.184347 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:06.184791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:06.185574 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:06.185991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:06.322142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:06.329742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-301b5f96-174b-4d58-bb12-c2159f2181f6 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.156693 Jan 10 12:53:06.330414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 412/853] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:06 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:07.347819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:07.348602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:07.355434 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:07.356009 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:07.356807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:07.357266 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:07.506999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:07.515237 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9e584b99-98b3-4fd0-9202-0c9b2d6a0fbd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.171286 Jan 10 12:53:07.515872 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 413/854] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:07 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:07.867799 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8c297aa5-9713-4039-9865-dc9d991a1e5f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 200 len: 38323 microversion: 2.20 time: 7.077128 Jan 10 12:53:07.868906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 442/855] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:53:00 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 38323 bytes in 7080 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:53:07.878518 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3e1830a2-a95e-4373-926f-f7c0bd225ef9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:07.879019 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3e1830a2-a95e-4373-926f-f7c0bd225ef9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:07.885086 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3e1830a2-a95e-4373-926f-f7c0bd225ef9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:07.885542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3e1830a2-a95e-4373-926f-f7c0bd225ef9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:07.886325 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3e1830a2-a95e-4373-926f-f7c0bd225ef9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:07.886763 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3e1830a2-a95e-4373-926f-f7c0bd225ef9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:07.910689 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3e1830a2-a95e-4373-926f-f7c0bd225ef9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/ips" status: 200 len: 150 microversion: 2.20 time: 0.035895 Jan 10 12:53:07.911278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 414/856] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jan 10 12:53:07 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:53:08.534146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:08.534725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:08.542294 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:08.542746 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:08.543570 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:08.544033 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:08.682578 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:08.696030 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6d32d9c5-b1b9-4927-8868-68390544b6bb tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.165860 Jan 10 12:53:08.697662 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 443/857] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:08 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:08.795351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-07d6b4f8-5a07-43cf-91cf-06c45eddff06 req-f0440ff9-614b-46c9-b4f3-a3490fa05725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5478e592-7324-4bd6-9745-c968db315d5c", "tag": "9ec4c725-d55d-40fa-a18c-f94c61bcb3b4"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:08.797085 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:08.797085 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:53:08.805576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-07d6b4f8-5a07-43cf-91cf-06c45eddff06 req-f0440ff9-614b-46c9-b4f3-a3490fa05725 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:08.806030 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-07d6b4f8-5a07-43cf-91cf-06c45eddff06 req-f0440ff9-614b-46c9-b4f3-a3490fa05725 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:08.818275 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-07d6b4f8-5a07-43cf-91cf-06c45eddff06 req-f0440ff9-614b-46c9-b4f3-a3490fa05725 service nova] Creating event network-changed:9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 for instance 5478e592-7324-4bd6-9745-c968db315d5c on hv-cinder-maste Jan 10 12:53:08.826098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-07d6b4f8-5a07-43cf-91cf-06c45eddff06 req-f0440ff9-614b-46c9-b4f3-a3490fa05725 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124409 Jan 10 12:53:08.826715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 415/858] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:09.714042 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:09.714929 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:09.724395 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:09.724851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:09.725884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:09.726379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:09.884486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:09.894417 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-eefddb3f-47e8-4c05-ba45-a71fe54215a4 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.184469 Jan 10 12:53:09.895007 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 444/859] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:09 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:10.070850 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:10.071441 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:10.078626 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:10.079071 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:10.079888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:10.080320 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:10.104588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lazy-loading 'flavor' on Instance uuid 09225d89-9a27-4364-a81c-ed60792c76f3 {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:53:10.423223 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b87a66ca-1d1b-4168-a3f1-3e25db9b20ba tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 202 len: 0 microversion: 2.20 time: 0.359196 Jan 10 12:53:10.423972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 416/860] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:53:10 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:53:10.432299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:10.433446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:10.441337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:10.441774 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:10.442560 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:10.443001 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:10.597447 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:10.608523 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:10.610644 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:10.611851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3bf55ba4-a644-4cc2-a0a9-c3c97306887b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.183452 Jan 10 12:53:10.612429 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 445/861] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:10 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:10.914845 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:10.915540 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:10.922301 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:10.922779 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:10.923562 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:10.924075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:11.064121 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:11.072541 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b125c67f-7fe5-4d54-9c8f-323fb255ef23 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.162423 Jan 10 12:53:11.073143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 417/862] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:10 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:11.633070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:11.634624 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:11.647002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:11.647631 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:11.648687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:11.649107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:11.805893 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:11.817763 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:11.820235 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:11.821851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-af7fc479-89a5-4e37-a0ee-068fb8b527b6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.193966 Jan 10 12:53:11.822477 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 446/863] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:11 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:12.090569 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:12.091372 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:12.100047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:12.100648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:12.101687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:12.102269 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:12.256944 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:12.264407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-451b0ca4-76dc-499c-a88b-15f27cde442e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.178566 Jan 10 12:53:12.265072 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 418/864] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:12 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:12.842832 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:12.843609 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:12.851790 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:12.852383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:12.853413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:12.853970 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:12.998148 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:13.006028 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:13.007545 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:13.008712 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-95e07a28-8a84-4bf4-8958-8c6541a5c363 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.170699 Jan 10 12:53:13.009743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 447/865] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:12 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:13.285330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:13.286211 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:13.294631 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:13.295104 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:13.295917 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:13.296351 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:13.438133 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:13.445811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7c38c2a2-82a6-42d5-8acf-208a3eb864a3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.166910 Jan 10 12:53:13.446660 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 419/866] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:13 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:14.031902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:14.033198 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:14.042634 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:14.043080 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:14.043911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:14.044340 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:14.189556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:14.198507 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:14.200393 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:14.201838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-62ef89a7-9e0a-433a-80df-edb63f3af794 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.177413 Jan 10 12:53:14.202533 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 448/867] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:14 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:14.378603 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-39ec6cd5-2cc2-42cf-a4e8-b9cdf9f11d98 req-e55ea212-2966-4284-b7a0-dd817a431235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5478e592-7324-4bd6-9745-c968db315d5c", "name": "network-vif-plugged", "status": "completed", "tag": "9ec4c725-d55d-40fa-a18c-f94c61bcb3b4"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:14.381406 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:14.381406 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:53:14.390077 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-39ec6cd5-2cc2-42cf-a4e8-b9cdf9f11d98 req-e55ea212-2966-4284-b7a0-dd817a431235 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:14.390529 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-39ec6cd5-2cc2-42cf-a4e8-b9cdf9f11d98 req-e55ea212-2966-4284-b7a0-dd817a431235 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:14.401946 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-39ec6cd5-2cc2-42cf-a4e8-b9cdf9f11d98 req-e55ea212-2966-4284-b7a0-dd817a431235 service nova] Creating event network-vif-plugged:9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 for instance 5478e592-7324-4bd6-9745-c968db315d5c on hv-cinder-maste Jan 10 12:53:14.407836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-39ec6cd5-2cc2-42cf-a4e8-b9cdf9f11d98 req-e55ea212-2966-4284-b7a0-dd817a431235 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090719 Jan 10 12:53:14.408581 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 420/868] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:14.463194 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:14.463851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:14.470249 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:14.470824 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:14.471927 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:14.472376 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:14.605214 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:14.612946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c7c54825-d389-487d-bd52-2292c25f4742 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.153605 Jan 10 12:53:14.613496 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 449/869] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:14 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:15.224811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:15.225952 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:15.237008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:15.237807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:15.239110 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:15.239895 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:15.380723 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:15.390334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:15.391872 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:15.393035 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f0a9c035-153f-4ee1-b31c-77a848ee4fa4 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.175180 Jan 10 12:53:15.393590 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 421/870] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:15 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:15.632460 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:15.633192 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:15.640225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:15.640681 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:15.641465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:15.641929 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:15.784414 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:15.791828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-927f2388-fb78-4899-afa5-efd538e99fc8 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1358 microversion: 2.1 time: 0.164508 Jan 10 12:53:15.792425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 450/871] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:15 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:16.415146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:16.416001 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:16.423144 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:16.423649 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:16.424499 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:16.424950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:16.566290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:16.578536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:16.580796 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:16.582532 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c9ff7adf-b0ee-47e5-a27a-1a75be411001 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.173464 Jan 10 12:53:16.583259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 422/872] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:16 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:16.810757 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:16.811330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:16.819210 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:16.819805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:16.820717 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:16.821245 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:16.956702 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:16.966684 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-95d72e0f-c641-4aef-9372-081207b186f9 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1549 microversion: 2.1 time: 0.161223 Jan 10 12:53:16.967289 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 451/873] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:16 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:16.985810 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:16.986807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:16.996055 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:16.996710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:16.997925 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:16.998638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:17.135294 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:17.142842 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8da00c74-9d82-43a9-a9dd-e446bd6a404b tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1549 microversion: 2.1 time: 0.163233 Jan 10 12:53:17.143419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 423/874] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:16 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:17.160672 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:17.166546 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:17.166546 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:53:17.167592 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:17.168349 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Searching by: {'deleted': False, 'project_id': '49b93adb02f6421e98d26e140bc17634'} {{(pid=123137) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 10 12:53:17.175685 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:17.176129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:17.176931 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:17.177360 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:17.267247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.multi_cell_list [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123137) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 10 12:53:17.364315 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-813cdcae-f640-412b-8ae2-de48c2080dd2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209088 Jan 10 12:53:17.364940 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 452/875] 10.222.0.13 () {58 vars in 1124 bytes} [Mon Jan 10 12:53:17 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:17.380223 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:17.381202 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:17.391682 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:17.392422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:17.393731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:17.394432 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:17.528859 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:17.536744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ad919123-91ba-4519-96ae-c9a58eda0e84 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1549 microversion: 2.1 time: 0.162682 Jan 10 12:53:17.537324 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 424/876] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:17 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:17.601235 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:17.601876 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:17.607936 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:17.608377 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:17.609146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:17.609572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:17.748121 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:17.757184 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:17.758709 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:17.760010 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7bb2c4f8-5f2a-49f7-b306-3027fa02d6b1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.162521 Jan 10 12:53:17.760801 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 453/877] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:17 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:18.778475 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:18.779052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:18.785755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:18.786243 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:18.787028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:18.787463 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:18.921693 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:18.929703 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:18.931212 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:18.932768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-257fb297-1f96-4364-a082-57397a5b1ca3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.158314 Jan 10 12:53:18.933720 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 425/878] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:18 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:19.050620 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a83b09e1-39a0-4b1e-b1bb-5a4b73798071 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a0d875c-5478-459c-a42d-d13404b8e449"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:19.051757 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a83b09e1-39a0-4b1e-b1bb-5a4b73798071 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:19.059122 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a83b09e1-39a0-4b1e-b1bb-5a4b73798071 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:19.059607 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a83b09e1-39a0-4b1e-b1bb-5a4b73798071 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:19.060399 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a83b09e1-39a0-4b1e-b1bb-5a4b73798071 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:19.060838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a83b09e1-39a0-4b1e-b1bb-5a4b73798071 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:19.310838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a83b09e1-39a0-4b1e-b1bb-5a4b73798071 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264175 Jan 10 12:53:19.311469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 454/879] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:53:19 2022] POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:19.954482 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:19.955424 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:19.966407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:19.967070 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:19.968447 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:19.969178 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:20.117955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:20.127246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:20.128947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:20.130322 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2696d23a-40fe-430d-8d1d-4f39c7cc7ad3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.182362 Jan 10 12:53:20.130978 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 426/880] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:19 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:21.153195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:21.153938 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:21.160607 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:21.161053 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:21.161824 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:21.162258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:21.299032 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:21.307138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:21.309036 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:21.310192 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7856dc8b-a53a-4dcd-aae2-e7f9178719f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.163912 Jan 10 12:53:21.310768 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 455/881] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:21 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:22.333335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:22.334255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:22.345823 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:22.346560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:22.347997 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:22.348713 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:22.494067 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:22.502153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:22.503662 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:22.504825 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0c4586a6-2306-40ed-9e4c-2bbccfdb2de9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.177806 Jan 10 12:53:22.505420 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 427/882] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:22 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:23.527050 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:23.527865 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:23.536572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:23.537175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:23.538305 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:23.538892 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:23.682610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:23.694686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:23.696806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:23.698398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-71c86faa-7fc0-44f4-9e65-b1c7cc2036fc tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.177374 Jan 10 12:53:23.698952 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 456/883] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:23 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:24.720800 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:24.721849 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:24.732672 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:24.733780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:24.735096 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:24.735898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:24.878300 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:24.886678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:24.888181 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:24.889377 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8139d9ec-c254-4513-bfa8-53b2839e24ac tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.175054 Jan 10 12:53:24.889952 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 428/884] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:24 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:25.907472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:25.908095 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:25.914748 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:25.915246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:25.916182 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:25.916617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:26.221917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:26.231319 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:26.232869 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:26.234041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c723bcc5-da76-425f-a5e7-792ebdbdf09d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1742 microversion: 2.20 time: 0.330333 Jan 10 12:53:26.234621 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 457/885] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:25 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1742 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:26.894642 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:26.895246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:26.902143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:26.902585 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:26.903360 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:26.903821 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:27.039329 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:27.047497 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6b2d05ed-eacf-4447-9150-efd9f3d8a564 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1595 microversion: 2.1 time: 0.156659 Jan 10 12:53:27.048085 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 429/886] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:26 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:27.252969 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:27.253572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:27.260082 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:27.260687 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:27.261475 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:27.261906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:27.469500 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:27.479362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:27.481703 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:27.482886 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4f55ff1a-3193-4b78-b45d-030f2d129c24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1742 microversion: 2.20 time: 0.233800 Jan 10 12:53:27.483450 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 458/887] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:27 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1742 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:28.504264 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:28.505014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:28.516283 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:28.516988 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:28.517871 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:28.518366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:28.965342 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:28.977451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:28.980668 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:28.982261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3ace652d-55a3-4232-9949-0e2f2d6216c5 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.484244 Jan 10 12:53:28.994305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 430/888] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:28 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:29.289761 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-f32fa0c9-bac2-4de0-971a-b12e3564d412 req-9ec708aa-0e30-4022-ad79-e84fdbbc1098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5478e592-7324-4bd6-9745-c968db315d5c", "tag": "9ec4c725-d55d-40fa-a18c-f94c61bcb3b4"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:29.294406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:29.294406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:53:29.329169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-f32fa0c9-bac2-4de0-971a-b12e3564d412 req-9ec708aa-0e30-4022-ad79-e84fdbbc1098 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:29.329854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-f32fa0c9-bac2-4de0-971a-b12e3564d412 req-9ec708aa-0e30-4022-ad79-e84fdbbc1098 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:29.344793 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-f32fa0c9-bac2-4de0-971a-b12e3564d412 req-9ec708aa-0e30-4022-ad79-e84fdbbc1098 service nova] Creating event network-changed:9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 for instance 5478e592-7324-4bd6-9745-c968db315d5c on hv-cinder-maste Jan 10 12:53:29.350977 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-f32fa0c9-bac2-4de0-971a-b12e3564d412 req-9ec708aa-0e30-4022-ad79-e84fdbbc1098 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161567 Jan 10 12:53:29.352729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 459/889] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:30.002290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:30.002290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:30.014859 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:30.016807 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:30.018125 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:30.020953 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:30.261291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:30.271106 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:30.272908 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:30.274397 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5802f331-6a9c-417b-abaf-0d56c38d916c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.277653 Jan 10 12:53:30.275224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 431/890] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:29 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:30.571424 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-9abfcb27-4e33-4fa3-8297-f9501e73c4e9 req-e9113ac4-485b-474c-a3cf-b816484dbf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09225d89-9a27-4364-a81c-ed60792c76f3", "name": "network-vif-plugged", "status": "completed", "tag": "dc3f0c02-667c-403b-91d3-b98ae7eeec12"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:30.573895 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:30.573895 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:53:30.583039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-9abfcb27-4e33-4fa3-8297-f9501e73c4e9 req-e9113ac4-485b-474c-a3cf-b816484dbf16 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:30.584592 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-9abfcb27-4e33-4fa3-8297-f9501e73c4e9 req-e9113ac4-485b-474c-a3cf-b816484dbf16 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:30.609372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-9abfcb27-4e33-4fa3-8297-f9501e73c4e9 req-e9113ac4-485b-474c-a3cf-b816484dbf16 service nova] Creating event network-vif-plugged:dc3f0c02-667c-403b-91d3-b98ae7eeec12 for instance 09225d89-9a27-4364-a81c-ed60792c76f3 on hv-cinder-maste Jan 10 12:53:30.620173 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-9abfcb27-4e33-4fa3-8297-f9501e73c4e9 req-e9113ac4-485b-474c-a3cf-b816484dbf16 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053304 Jan 10 12:53:30.621128 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 460/891] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:30.628386 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1053222225"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:30.629009 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:30.641376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:30.642113 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:30.643287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:30.644621 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:30.844860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.network.security_group_api [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Adding security group af0a998d-eb25-457e-9bb3-1752e581a4d1 to port 9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 Jan 10 12:53:31.294058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:31.295222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:31.310873 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:31.319123 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:31.321892 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:31.322648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:31.446269 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f2b12587-e4ec-4a7c-8418-73d293c05f25 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/action" status: 202 len: 0 microversion: 2.1 time: 0.824727 Jan 10 12:53:31.448402 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 432/892] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:53:30 2022] POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/action => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:53:31.458384 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:31.459358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:31.466970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:31.470999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:31.472360 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:31.473602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:31.725522 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:31.737383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:31.739630 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:31.741642 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-374e691e-da38-4a17-8dd5-ebf275449347 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.452264 Jan 10 12:53:31.746038 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 461/893] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:31 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:53:31.753174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-077e0d22-65e1-4dff-8b23-f37becf272c8 req-ddaf7e24-9644-4f5c-af9f-8d5bb81f4ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5478e592-7324-4bd6-9745-c968db315d5c", "tag": "9ec4c725-d55d-40fa-a18c-f94c61bcb3b4"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:31.758471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:31.758471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:53:31.769024 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-077e0d22-65e1-4dff-8b23-f37becf272c8 req-ddaf7e24-9644-4f5c-af9f-8d5bb81f4ffe service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:31.770686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-077e0d22-65e1-4dff-8b23-f37becf272c8 req-ddaf7e24-9644-4f5c-af9f-8d5bb81f4ffe service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:31.788206 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:31.789815 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-077e0d22-65e1-4dff-8b23-f37becf272c8 req-ddaf7e24-9644-4f5c-af9f-8d5bb81f4ffe service nova] Creating event network-changed:9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 for instance 5478e592-7324-4bd6-9745-c968db315d5c on hv-cinder-maste Jan 10 12:53:31.795811 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-077e0d22-65e1-4dff-8b23-f37becf272c8 req-ddaf7e24-9644-4f5c-af9f-8d5bb81f4ffe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Jan 10 12:53:31.796771 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 462/894] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:31.800411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c1895787-1a32-4135-b713-33d84d834e57 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1760 microversion: 2.1 time: 0.347218 Jan 10 12:53:31.808700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 433/895] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:31 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1760 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:32.766854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:32.768362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:32.775375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:32.776436 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:32.777489 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:32.777943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:32.920371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:32.932587 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:32.934614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:32.936016 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-383d3b2f-201e-4e44-9af0-a518c8822501 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.176275 Jan 10 12:53:32.938682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 463/896] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:32 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:33.956618 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:33.957280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:33.964453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:33.965013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:33.965920 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:33.966426 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:34.114450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:34.125740 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:34.127257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:34.128479 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5524647d-d85c-49b1-9a98-d26704c47c7c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.175695 Jan 10 12:53:34.138536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 434/897] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:33 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:34.896419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0cf4ab76-8af6-4fa5-b8cc-8ae993049f6a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:34.897355 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0cf4ab76-8af6-4fa5-b8cc-8ae993049f6a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:34.904440 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0cf4ab76-8af6-4fa5-b8cc-8ae993049f6a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:34.904906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0cf4ab76-8af6-4fa5-b8cc-8ae993049f6a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:34.905762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0cf4ab76-8af6-4fa5-b8cc-8ae993049f6a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:34.906213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0cf4ab76-8af6-4fa5-b8cc-8ae993049f6a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:34.944759 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0cf4ab76-8af6-4fa5-b8cc-8ae993049f6a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052005 Jan 10 12:53:34.945594 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 464/898] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:53:34 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:53:35.004860 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:35.005479 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:35.012559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.013013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.013815 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.014253 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.040695 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:53:35.148097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:35.148822 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:35.155636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.156167 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.157039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.157497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.176180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f80c52ec-f215-4614-a6e5-a020f94c0941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 204 len: 0 microversion: 2.1 time: 0.174802 Jan 10 12:53:35.176777 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 435/899] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:53:34 2022] DELETE /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:53:35.186559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:35.187280 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:35.195838 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.196773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.197107 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.198260 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.333568 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:35.349199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:35.357191 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:35.360438 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ff405404-7a7d-42ae-bab6-4acb58a0b816 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.216354 Jan 10 12:53:35.361011 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 465/900] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:35 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:53:35.413638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:35.421487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4568cb6f-6798-426e-8db0-680b54cd1d82 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1673 microversion: 2.1 time: 0.240251 Jan 10 12:53:35.422290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 436/901] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:35 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:35.579903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:35.580750 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:35.586701 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.587389 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.588273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.588715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.622346 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Going to try to terminate instance {{(pid=123137) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:53:35.716181 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-560d4f38-cf29-43c3-9317-72ed03b5317c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 204 len: 0 microversion: 2.1 time: 0.138192 Jan 10 12:53:35.717858 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 466/902] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:53:35 2022] DELETE /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:53:35.726972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:35.727846 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:35.737145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.737654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.739033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:35.739467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:35.887834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:35.897156 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a08fa12c-d971-4b1a-a299-d61df3ea1439 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1575 microversion: 2.1 time: 0.174614 Jan 10 12:53:35.898630 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 437/903] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:35 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:36.378766 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:36.379469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:36.386682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:36.387220 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:36.388066 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:36.388524 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:36.438654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:36.439290 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:36.446028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:36.446484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:36.447338 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:36.447795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:36.578375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:36.588567 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:36.590169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:36.591378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b80925c2-5c26-4e68-bbc6-6b021294318b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.216834 Jan 10 12:53:36.602195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 467/904] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:36 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:36.648125 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:36.656512 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c6ff2736-8dbb-487a-9d74-6791a0ab2bd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1673 microversion: 2.1 time: 0.221569 Jan 10 12:53:36.657411 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 438/905] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:36 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:36.914504 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:36.915152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:36.921406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:36.921862 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:36.922661 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:36.923781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:37.081995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:37.093203 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7fe8fc87-f83a-49dc-be0f-1d0cf4791db8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1575 microversion: 2.1 time: 0.182687 Jan 10 12:53:37.093791 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 468/906] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:36 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:37.609647 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:37.611627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:37.617638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:37.618220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:37.619191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:37.619729 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:37.679541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:37.680174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:37.698405 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:37.698898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:37.699810 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:37.700254 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:37.840552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:37.853576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:37.855110 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:37.856664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9106c526-4990-4dce-b94b-8a7e84b86392 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.250683 Jan 10 12:53:37.858278 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 439/907] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:37 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:37.966163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:37.974934 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1e930bfa-d6e5-42be-91d3-c8552bd280d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1673 microversion: 2.1 time: 0.301586 Jan 10 12:53:37.976299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 469/908] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:37 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1673 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:38.110960 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:38.111727 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:38.123039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:38.123827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:38.124311 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:38.124744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:38.302493 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:38.312866 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-acbe074d-843a-444e-b457-5724c6b41392 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1575 microversion: 2.1 time: 0.206460 Jan 10 12:53:38.323592 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 440/909] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:38 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:38.875974 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:38.876573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:38.883656 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:38.884119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:38.885057 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:38.885532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:38.992505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:38.993084 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:39.004205 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:39.005509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:39.007862 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:39.008424 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:39.041136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:39.053427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:39.054963 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:39.056448 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f6c3bfc8-350b-44b7-adc5-1522c043d61b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1737 microversion: 2.20 time: 0.184366 Jan 10 12:53:39.057497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 470/910] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:38 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:39.116972 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:39.127630 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-244ae5e8-5d4b-422a-8d57-67e505395799 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 200 len: 1605 microversion: 2.1 time: 0.138430 Jan 10 12:53:39.128459 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 441/911] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:38 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 1605 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:39.330080 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:39.330690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:39.337256 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:39.338212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:39.338837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:39.339103 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:39.412084 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:39.424863 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0a890712-e3f1-4e32-9752-1fee05deaaa2 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 200 len: 1508 microversion: 2.1 time: 0.098488 Jan 10 12:53:39.426124 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 471/912] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:39 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 1508 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:39.492324 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-0c174b61-561d-48ab-81a6-cb4c56ecadc8 req-207885ff-b69e-487b-b127-dc25376516f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04a2f28-f535-468a-ba8b-39cdc590147b", "name": "network-vif-deleted", "tag": "31d2ebb9-0259-4cf8-a5d4-2cc46318279f"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:39.496787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:39.496787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:53:39.508060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-0c174b61-561d-48ab-81a6-cb4c56ecadc8 req-207885ff-b69e-487b-b127-dc25376516f2 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:39.508505 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-0c174b61-561d-48ab-81a6-cb4c56ecadc8 req-207885ff-b69e-487b-b127-dc25376516f2 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:39.537052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-0c174b61-561d-48ab-81a6-cb4c56ecadc8 req-207885ff-b69e-487b-b127-dc25376516f2 service nova] Creating event network-vif-deleted:31d2ebb9-0259-4cf8-a5d4-2cc46318279f for instance d04a2f28-f535-468a-ba8b-39cdc590147b on hv-cinder-maste Jan 10 12:53:39.547623 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-0c174b61-561d-48ab-81a6-cb4c56ecadc8 req-207885ff-b69e-487b-b127-dc25376516f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061776 Jan 10 12:53:39.549724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 442/913] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:40.076385 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:40.077881 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:40.085023 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:40.085791 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:40.086797 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:40.087851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:40.146307 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:40.147715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:40.158583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:40.160166 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:40.161460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:40.162365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:40.183367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] HTTP exception thrown: Instance d04a2f28-f535-468a-ba8b-39cdc590147b could not be found. Jan 10 12:53:40.184294 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Returning 404 to user: Instance d04a2f28-f535-468a-ba8b-39cdc590147b could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:53:40.185316 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f981070d-ee49-4eec-9b7a-e34cf288a0df tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 404 len: 111 microversion: 2.1 time: 0.043139 Jan 10 12:53:40.189887 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 443/914] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:40 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 12:53:40.194878 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-575ea229-6830-484e-bce7-0b9c64481cb1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '.version_select at 0x7f7fca6163a0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:40.218816 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-575ea229-6830-484e-bce7-0b9c64481cb1 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180185655" status: 202 len: 0 microversion: 2.1 time: 0.027262 Jan 10 12:53:40.224488 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 444/915] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jan 10 12:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180185655 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:53:40.261123 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:40.274107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:40.276774 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:40.278094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b3a60db7-a9b6-4996-97be-2d29807b2acf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1719 microversion: 2.20 time: 0.206113 Jan 10 12:53:40.279831 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 472/916] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:40 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:53:40.446455 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:40.447774 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:40.466794 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:40.468082 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:40.469217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:40.469742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:40.487456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] HTTP exception thrown: Instance 508c5420-5725-4665-b594-8990cf7bc668 could not be found. Jan 10 12:53:40.488245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Returning 404 to user: Instance 508c5420-5725-4665-b594-8990cf7bc668 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:53:40.489160 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3b412d26-4401-4a12-baa2-07eadde15d41 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 404 len: 111 microversion: 2.1 time: 0.050591 Jan 10 12:53:40.492692 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 445/917] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:40 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:53:40.606679 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-46872652", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-174268589", "security_groups": [{"name": "tempest-secgroup-smoke-849435366"}], "block_device_mapping_v2": [{"uuid": "ab7a1724-91fb-4de8-88d9-dd9d70f3b996", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c5b8c8b5-d1c3-4f27-9dc6-e0e5ca957245"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:40.744530 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] validate_networks() for [('c5b8c8b5-d1c3-4f27-9dc6-e0e5ca957245', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:53:41.044000 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ca46b69f-b7dd-46fe-b677-ed0f876b3ca0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'create', calling method: .version_select at 0x7f7fca616ca0>, body: {"keypair": {"name": "tempest-keypair-1419061961"}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:41.058389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-ca46b69f-b7dd-46fe-b677-ed0f876b3ca0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:53:41.065039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-ca46b69f-b7dd-46fe-b677-ed0f876b3ca0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for user 9bbc10f093cd4a3f9de4d874cfa8b831 and project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:53:41.201530 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:53:41.201970 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:53:41.202470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:53:41.202883 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:53:41.203292 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:53:41.216033 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:41.216614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:41.217711 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:41.218227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:41.227024 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-ca46b69f-b7dd-46fe-b677-ed0f876b3ca0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:53:41.230795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-ca46b69f-b7dd-46fe-b677-ed0f876b3ca0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for user 9bbc10f093cd4a3f9de4d874cfa8b831 and project 42f048bd448f467aa0b37935d03a60e9. Resources: {'key_pairs'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:53:41.234902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:53:41.238871 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for user ffd65d5f1d484d48a3ed84cf1592956c and project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:53:41.243483 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ca46b69f-b7dd-46fe-b677-ed0f876b3ca0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.204954 Jan 10 12:53:41.244544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 446/918] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Jan 10 12:53:41 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:41.294715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:53:41.296549 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:41.296957 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab7a1724-91fb-4de8-88d9-dd9d70f3b996',volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:53:41.297300 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:41.308497 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:41.309047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:41.309937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:41.310588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:41.445991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1232d512-6462-4fab-956c-d4a631c1ad89 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.843007 Jan 10 12:53:41.448369 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 473/919] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:53:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 12:53:41.459994 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a6a74946-881b-4651-9c6e-3a48573b72ba tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:41.461047 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a6a74946-881b-4651-9c6e-3a48573b72ba tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:41.476166 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:41.486088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:41.488047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:41.489360 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b81ceeaf-eb76-43d2-9607-83246255acbf tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1719 microversion: 2.20 time: 0.196625 Jan 10 12:53:41.489933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 447/920] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:41 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:53:41.537968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a6a74946-881b-4651-9c6e-3a48573b72ba tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:41.545946 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a6a74946-881b-4651-9c6e-3a48573b72ba tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1092 microversion: 2.1 time: 0.091410 Jan 10 12:53:41.548181 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 474/921] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:41 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1092 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:41.594952 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-7f1f6991-0600-4ab4-94d8-5ad8bd866440 req-f4634d37-ad74-496e-88af-c076cb8ddded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508c5420-5725-4665-b594-8990cf7bc668", "name": "network-vif-deleted", "tag": "b0c8664c-1be2-4aa4-ad7d-298feadd5169"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:41.599297 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:41.599297 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:53:41.604723 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-7f1f6991-0600-4ab4-94d8-5ad8bd866440 req-f4634d37-ad74-496e-88af-c076cb8ddded service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:41.605344 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-7f1f6991-0600-4ab4-94d8-5ad8bd866440 req-f4634d37-ad74-496e-88af-c076cb8ddded service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:41.620178 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-7f1f6991-0600-4ab4-94d8-5ad8bd866440 req-f4634d37-ad74-496e-88af-c076cb8ddded service nova] Creating event network-vif-deleted:b0c8664c-1be2-4aa4-ad7d-298feadd5169 for instance 508c5420-5725-4665-b594-8990cf7bc668 on hv-cinder-maste Jan 10 12:53:41.625708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-7f1f6991-0600-4ab4-94d8-5ad8bd866440 req-f4634d37-ad74-496e-88af-c076cb8ddded service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035180 Jan 10 12:53:41.626418 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 448/922] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:53:42.429706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-afff89bf-bf6d-4f5e-b7a7-b52fe098befd req-9edb8e87-00a4-4ac2-b0ff-5e2cb7dbb8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09225d89-9a27-4364-a81c-ed60792c76f3", "name": "network-vif-unplugged", "status": "completed", "tag": "dc3f0c02-667c-403b-91d3-b98ae7eeec12"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:42.431752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:42.431752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:53:42.444073 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-afff89bf-bf6d-4f5e-b7a7-b52fe098befd req-9edb8e87-00a4-4ac2-b0ff-5e2cb7dbb8f8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:42.444569 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-afff89bf-bf6d-4f5e-b7a7-b52fe098befd req-9edb8e87-00a4-4ac2-b0ff-5e2cb7dbb8f8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:42.457637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.compute.server_external_events [req-afff89bf-bf6d-4f5e-b7a7-b52fe098befd req-9edb8e87-00a4-4ac2-b0ff-5e2cb7dbb8f8 service nova] Unable to find a host for instance 09225d89-9a27-4364-a81c-ed60792c76f3. Dropping event network-vif-unplugged {{(pid=123137) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 10 12:53:42.459002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-afff89bf-bf6d-4f5e-b7a7-b52fe098befd req-9edb8e87-00a4-4ac2-b0ff-5e2cb7dbb8f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033214 Jan 10 12:53:42.460258 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 475/923] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 10 12:53:42.509389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:42.510102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:42.517183 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:42.517941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:42.518970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:42.519621 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:42.563332 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:42.564527 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:42.576398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:42.577247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:42.578144 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:42.578645 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:42.669827 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:42.678275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-846ef095-79c3-4f73-9353-386f1c55ab02 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1198 microversion: 2.1 time: 0.119174 Jan 10 12:53:42.689586 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 476/924] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:42 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:42.759537 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:42.769986 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:42.772710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:42.773931 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c30481e8-ffc9-4aec-87c8-81e6598a9d7b tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1662 microversion: 2.20 time: 0.270127 Jan 10 12:53:42.774921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 449/925] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:42 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1662 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:42.792497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-95024b90-e6e4-4ecd-a064-871e6a52468d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73413b0a-a881-4091-8f15-349ef00dd86d"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:42.793661 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-95024b90-e6e4-4ecd-a064-871e6a52468d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:42.799947 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95024b90-e6e4-4ecd-a064-871e6a52468d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:42.800396 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95024b90-e6e4-4ecd-a064-871e6a52468d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:42.801177 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95024b90-e6e4-4ecd-a064-871e6a52468d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:42.801630 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95024b90-e6e4-4ecd-a064-871e6a52468d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:42.821967 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1424623586", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87c964fb-a880-497c-9fae-14b2acc2e4e6"}], "security_groups": [{"name": "tempest-securitygroup--156212466"}], "key_name": "tempest-keypair-1419061961", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:42.926963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.network.neutron [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] validate_networks() for [('87c964fb-a880-497c-9fae-14b2acc2e4e6', None, None, None, None, None)] {{(pid=123138) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:53:43.151348 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-95024b90-e6e4-4ecd-a064-871e6a52468d tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362861 Jan 10 12:53:43.152186 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 477/926] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jan 10 12:53:42 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-volume_attachments => generated 188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:53:43.295027 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c8ea626f-8811-4c62-a6d5-228645c9251e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:43.296109 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c8ea626f-8811-4c62-a6d5-228645c9251e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:43.304652 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c8ea626f-8811-4c62-a6d5-228645c9251e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.305353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c8ea626f-8811-4c62-a6d5-228645c9251e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.306573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c8ea626f-8811-4c62-a6d5-228645c9251e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.308602 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c8ea626f-8811-4c62-a6d5-228645c9251e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.395013 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Flavor limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:53:43.395461 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Image limits 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:53:43.395957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Flavor pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:53:43.396373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Image pref 0:0:0 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:53:43.396785 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.virt.hardware [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123138) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:53:43.411333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.411802 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.413335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.413783 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.440979 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for project 42f048bd448f467aa0b37935d03a60e9. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:53:43.445407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.quota [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Getting quotas for user 9bbc10f093cd4a3f9de4d874cfa8b831 and project 42f048bd448f467aa0b37935d03a60e9. Resources: {'ram', 'instances', 'cores'} {{(pid=123138) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:53:43.472744 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Going to run 1 instances... {{(pid=123138) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:53:43.475273 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123138) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:53:43.532301 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-86285054-9fb5-40f1-a3a1-a2686b9f9de2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.714424 Jan 10 12:53:43.534539 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 450/927] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:53:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 12:53:43.547079 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ed6b70d3-2af4-409b-a94f-997911798c4d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:43.551751 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ed6b70d3-2af4-409b-a94f-997911798c4d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:43.619117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ed6b70d3-2af4-409b-a94f-997911798c4d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:43.627056 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ed6b70d3-2af4-409b-a94f-997911798c4d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1238 microversion: 2.1 time: 0.086421 Jan 10 12:53:43.627729 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 451/928] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:43 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:43.667573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c8ea626f-8811-4c62-a6d5-228645c9251e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-volume_attachments/73413b0a-a881-4091-8f15-349ef00dd86d" status: 202 len: 0 microversion: 2.20 time: 0.378574 Jan 10 12:53:43.668571 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 478/929] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jan 10 12:53:43 2022] DELETE /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-volume_attachments/73413b0a-a881-4091-8f15-349ef00dd86d => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 10 12:53:43.696123 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:43.697111 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:43.703693 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.704242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.705179 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.705691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.748544 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f223eac0-5dae-4061-86c6-b4e55549df43 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:43.749089 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f223eac0-5dae-4061-86c6-b4e55549df43 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:43.755078 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f223eac0-5dae-4061-86c6-b4e55549df43 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.755484 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f223eac0-5dae-4061-86c6-b4e55549df43 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.756311 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f223eac0-5dae-4061-86c6-b4e55549df43 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.756749 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f223eac0-5dae-4061-86c6-b4e55549df43 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.878270 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f223eac0-5dae-4061-86c6-b4e55549df43 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action" status: 202 len: 0 microversion: 2.20 time: 0.131222 Jan 10 12:53:43.884371 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 479/930] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jan 10 12:53:43 2022] POST /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 10 12:53:43.894901 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:43.895556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:43.908969 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:43.909826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.910291 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.911094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:43.918786 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:43.920611 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-68d6bbfa-9bf5-42a4-97c3-22fdff1010c5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.227834 Jan 10 12:53:43.922033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 452/931] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:43 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:44.157155 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:44.172151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:44.173682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:44.174872 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-aeda6b0a-6458-446d-8de9-24fc63f69bd7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1670 microversion: 2.20 time: 0.289217 Jan 10 12:53:44.177618 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 480/932] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:43 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:44.198145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-28753e21-53b2-4606-839e-5013f13b8994 req-e045cd71-cc0b-4710-9e7f-11b1d3250de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ec6184-c920-4234-a9f6-5e726a1be681", "tag": "b7bcefb3-698a-4790-bca2-57d443e10d43"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:44.204242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:44.204242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:53:44.218080 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-28753e21-53b2-4606-839e-5013f13b8994 req-e045cd71-cc0b-4710-9e7f-11b1d3250de0 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:44.219325 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-28753e21-53b2-4606-839e-5013f13b8994 req-e045cd71-cc0b-4710-9e7f-11b1d3250de0 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:44.240688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-28753e21-53b2-4606-839e-5013f13b8994 req-e045cd71-cc0b-4710-9e7f-11b1d3250de0 service nova] Creating event network-changed:b7bcefb3-698a-4790-bca2-57d443e10d43 for instance 17ec6184-c920-4234-a9f6-5e726a1be681 on hv-cinder-maste Jan 10 12:53:44.246691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-28753e21-53b2-4606-839e-5013f13b8994 req-e045cd71-cc0b-4710-9e7f-11b1d3250de0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052354 Jan 10 12:53:44.249358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 453/933] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:44.646230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:44.646851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:44.661323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:44.662595 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:44.663613 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:44.664209 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:44.732434 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:44.740102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d8005ca3-8cbb-4980-951a-299479f9c10e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1290 microversion: 2.1 time: 0.100191 Jan 10 12:53:44.740688 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 481/934] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:44 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:44.938812 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:44.939544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:44.946417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:44.947390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:44.948405 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:44.948994 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:45.096144 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:45.103981 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7c277e9b-d2a0-47a8-b7b3-eb77e6d4508b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.169168 Jan 10 12:53:45.104566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 454/935] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:44 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:45.194553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:45.195159 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:45.201960 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:45.202410 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:45.203224 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:45.203697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:45.344039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:45.352942 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:45.354491 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:45.355720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b865db2c-52aa-49ed-8913-c6e00b5dfe50 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.165025 Jan 10 12:53:45.356552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 482/936] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:45 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:45.758321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:45.758954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:45.766227 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:45.766674 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:45.767460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:45.767930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:45.827393 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:45.835305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3c072fe7-3f8c-4561-b2dd-90a915aba64a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1296 microversion: 2.1 time: 0.080894 Jan 10 12:53:45.836414 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 455/937] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:45 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:46.121072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:46.121690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:46.128670 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:46.129147 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:46.130123 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:46.130668 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:46.269057 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:46.276532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-95aab00a-f19a-4ade-a92f-959021346900 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.159394 Jan 10 12:53:46.285585 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 483/938] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:46 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:46.375937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:46.376409 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:46.382577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:46.383029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:46.383863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:46.384332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:46.523845 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:46.532440 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:46.533951 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:46.535146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-13d76d11-7416-4720-b190-20e078589a87 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.164090 Jan 10 12:53:46.535745 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 456/939] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:46 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:46.852779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:46.853536 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:46.860617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:46.861338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:46.862477 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:46.862758 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:47.089204 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:47.106133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6c89645b-813a-434f-9894-3aa02962b329 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.256865 Jan 10 12:53:47.107486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 484/940] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:46 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:47.293142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:47.295118 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:47.313028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:47.313491 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:47.317686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:47.318193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:47.457412 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-b8b1b76a-216d-48f8-82b2-1a9f7fb86a1c req-ee9434ab-5351-4f0c-a7fb-f61ea8bad5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa1635d-336e-4ff1-b152-bfa017da324b", "tag": "ae828662-bdad-421c-96d6-5bded1ca3706"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:47.459310 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:53:47.459310 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:53:47.471288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b8b1b76a-216d-48f8-82b2-1a9f7fb86a1c req-ee9434ab-5351-4f0c-a7fb-f61ea8bad5cb service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:47.472333 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-b8b1b76a-216d-48f8-82b2-1a9f7fb86a1c req-ee9434ab-5351-4f0c-a7fb-f61ea8bad5cb service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:47.485322 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-b8b1b76a-216d-48f8-82b2-1a9f7fb86a1c req-ee9434ab-5351-4f0c-a7fb-f61ea8bad5cb service nova] Creating event network-changed:ae828662-bdad-421c-96d6-5bded1ca3706 for instance aaa1635d-336e-4ff1-b152-bfa017da324b on hv-cinder-maste Jan 10 12:53:47.492014 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-b8b1b76a-216d-48f8-82b2-1a9f7fb86a1c req-ee9434ab-5351-4f0c-a7fb-f61ea8bad5cb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Jan 10 12:53:47.494122 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 485/941] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:53:47.554984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:47.556510 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:47.558503 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:47.568648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-480360d1-3b0f-4792-95ca-37f4b7f63707 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.279179 Jan 10 12:53:47.571507 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:47.572122 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:47.573030 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:47.573740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:47.578670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 457/942] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:47 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:47.727688 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:47.749643 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:47.751189 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:47.753152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-309367eb-339c-4679-b39b-ad7f661ff4f3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.203169 Jan 10 12:53:47.755604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 486/943] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:47 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:48.123504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:48.124277 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:48.136023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:48.136631 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:48.137446 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:48.137888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:48.489038 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:48.498334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-06979f21-eb8a-451f-8df4-1bb303a4571c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.378478 Jan 10 12:53:48.504559 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 458/944] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:48 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:48.587083 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:48.588288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:48.594925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:48.595375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:48.596201 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:48.596636 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:48.737525 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:48.745570 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c714b55b-f7df-4dd1-9122-6fa91b8057c0 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.162788 Jan 10 12:53:48.746163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 487/945] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:48 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:48.772408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:48.774355 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:48.782043 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:48.782477 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:48.783287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:48.783756 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:48.919265 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:48.928157 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:48.929739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:48.930999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0757fd3f-cf61-4bab-92cd-066badb08019 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.162655 Jan 10 12:53:48.933407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 459/946] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:48 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:49.515768 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:49.516369 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:49.524512 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:49.525200 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:49.526105 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:49.526538 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:49.660609 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:49.669345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-56137453-473f-4134-ab21-f79981df4862 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.157356 Jan 10 12:53:49.669936 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 488/947] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:49 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:49.762429 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:49.763737 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:49.770743 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:49.771215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:49.772130 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:49.772636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:49.915076 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:49.924335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-990dea6c-0c72-4fb3-b83b-454e631e24c3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.165395 Jan 10 12:53:49.926540 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 460/948] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:49 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:49.950692 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:49.951482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:49.959199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:49.959688 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:49.960514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:49.960947 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:50.121078 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:50.129993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:50.131800 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:50.133489 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f75f6151-1501-4232-97a2-7744770363da tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.187128 Jan 10 12:53:50.134777 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 489/949] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:49 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:53:50.688644 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:50.689582 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:50.696151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:50.696732 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:50.697783 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:50.698246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:50.839241 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:50.847055 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-00132e47-4309-4164-9596-d605c39fbd7e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.165234 Jan 10 12:53:50.847843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 461/950] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:50 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:50.943247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:50.943965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:50.951859 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:50.952323 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:50.953154 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:50.953608 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:51.094389 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:51.102407 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-49baa365-6a0b-42b5-b940-985f80b266e4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.163909 Jan 10 12:53:51.103452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 490/951] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:50 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:51.154331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:51.155171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:51.161574 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:51.162108 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:51.162962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:51.163470 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:51.303638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:51.313245 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:51.319965 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:51.321339 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-eee7668c-b864-47c3-a284-144bc7ae0fa9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.171456 Jan 10 12:53:51.328950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 462/952] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:51 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:51.864656 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:51.865419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:51.871931 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:51.872606 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:51.873516 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:51.873961 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:52.017275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:52.024986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6bfe4626-8aa1-425e-96cc-cdfeadb901a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.164304 Jan 10 12:53:52.025693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 491/953] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:51 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:52.120286 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:52.120941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:52.127371 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:52.127923 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:52.128706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:52.129149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:52.280660 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:52.288366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-dee7625f-e0a0-4669-8acb-23cbca1f9fcf tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.172257 Jan 10 12:53:52.288962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 463/954] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:52 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:52.341612 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:52.342334 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:52.348491 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:52.349017 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:52.349875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:52.350386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:52.482722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:52.491173 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:52.493070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:52.494576 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ddc405c8-d784-4e49-b44c-809809f556aa tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.156841 Jan 10 12:53:52.495447 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 492/955] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:52 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:53.042164 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:53.042991 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:53.049547 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:53.049998 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:53.050795 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:53.051231 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:53.197394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:53.206257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-10af0aad-e5f0-41d9-a916-f6b12371745a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.167987 Jan 10 12:53:53.207153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 464/956] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:53 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:53.305013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:53.305609 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:53.313177 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:53.313958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:53.314965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:53.315642 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:53.452088 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:53.460136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cf6c152a-cdc6-41e5-8d30-a50c2eecee26 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.158901 Jan 10 12:53:53.462444 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 493/957] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:53 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:53.512983 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:53.513624 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:53.520765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:53.521219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:53.522017 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:53.522455 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:53.670326 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:53.678774 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:53.680322 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:53.681555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2ca77927-c4bd-41c1-ad29-ca886dc012e9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.172925 Jan 10 12:53:53.682125 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 465/958] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:53 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:54.223065 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:54.223715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:54.230463 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:54.230913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:54.231835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:54.232277 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:54.376713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:54.385018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-a91bf677-0899-44fc-b5f1-3a2f69db7395 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.165591 Jan 10 12:53:54.385617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 494/959] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:54 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:54.478105 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:54.479302 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:54.486063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:54.486517 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:54.487380 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:54.487929 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:54.625423 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:54.633753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a0e25544-f190-4f6d-9b9a-4dd08fe22e0a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.159292 Jan 10 12:53:54.634349 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 466/960] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:54 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:54.701129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:54.701746 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:54.708012 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:54.708474 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:54.709360 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:54.709800 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:54.853998 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:54.863308 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:54.864914 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:54.866095 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-613551f6-4546-459e-be26-e6fafe558b73 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.169325 Jan 10 12:53:54.866649 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 495/961] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:54 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:53:55.401805 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:55.402456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:55.408592 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:55.409087 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:55.409820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:55.410239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:55.542270 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:55.550204 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-71e5b550-5d54-49c5-82e7-38e789e62b9b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.151969 Jan 10 12:53:55.551144 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 467/962] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:55 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:55.650991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:55.651788 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:55.658556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:55.659011 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:55.659855 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:55.660307 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:55.796507 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:55.803917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6deb8cbb-cfd3-472d-ac55-1c7497b52196 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.156723 Jan 10 12:53:55.804584 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 496/963] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:55 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:55.884203 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:55.885374 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:55.891675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:55.892195 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:55.893055 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:55.893560 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.031167 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:56.039673 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:56.041316 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:56.042483 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4ffcd0d8-ae6e-4fab-b80b-14fc2eb598c2 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.162044 Jan 10 12:53:56.043090 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 468/964] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:55 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:56.456664 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5953ceba-e527-4c8c-8179-b9800be85dce tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:53:56.458353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5953ceba-e527-4c8c-8179-b9800be85dce tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:56.466615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5953ceba-e527-4c8c-8179-b9800be85dce tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.467073 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5953ceba-e527-4c8c-8179-b9800be85dce tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.467913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5953ceba-e527-4c8c-8179-b9800be85dce tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.468358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5953ceba-e527-4c8c-8179-b9800be85dce tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.544647 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5953ceba-e527-4c8c-8179-b9800be85dce tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/action" status: 202 len: 0 microversion: 2.1 time: 0.094241 Jan 10 12:53:56.545425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 497/965] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:53:56 2022] POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:53:56.554121 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:56.554898 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:56.563155 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.563660 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.564791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.564929 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.570842 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:56.570842 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:56.581708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.582211 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.583047 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.583494 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.800036 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:56.806002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:56.808805 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-62938255-f7ea-4c17-93aa-a04ba582ebdd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.243290 Jan 10 12:53:56.809670 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 498/966] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:56 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:56.816188 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f53b852d-2fb9-4629-a463-e44a212cadbc tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1752 microversion: 2.1 time: 0.265637 Jan 10 12:53:56.819944 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 469/967] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:56 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1752 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:53:56.821263 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:56.822092 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:56.829268 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.829720 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.830515 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:56.830949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:56.965883 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:56.973884 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-b958a23f-20f5-4d1f-aabb-e911739d4dc5 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.156398 Jan 10 12:53:56.974660 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 499/968] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:56 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:57.061234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:57.062011 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:57.068438 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:57.068896 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:57.069687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:57.070149 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:57.205353 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:57.214212 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:57.215696 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:57.216851 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f0359c1c-f218-4c26-9b63-d0c7dba25a24 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.159839 Jan 10 12:53:57.217419 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 470/969] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:57 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:57.827639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:57.828563 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:57.836679 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:57.837555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:57.837788 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:57.838397 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:57.839507 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:57.840690 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:57.844962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:57.845420 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:57.846219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:57.846654 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:58.051018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:58.059971 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ffc18ff0-a75a-4a5e-9628-c6ff8c5b66b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.237774 Jan 10 12:53:58.060595 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 500/970] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:57 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:58.065386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:58.066260 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:58.069397 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:58.074903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:58.075616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:58.076415 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:58.076903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:58.079664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f2c45944-4581-4ee6-89d7-f287164df5c2 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.248491 Jan 10 12:53:58.080233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 471/971] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:57 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:58.209916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:58.217641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f44fdf07-341d-4c9b-8007-fdb5edd61099 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.156074 Jan 10 12:53:58.218229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 501/972] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:58 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:58.234451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:58.235093 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:58.241211 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:58.241663 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:58.242438 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:58.242872 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:58.385940 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:58.394570 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:58.396891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:58.398545 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5475751b-fed4-4fe0-b09d-a9bd89040cb7 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.168053 Jan 10 12:53:58.399151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 472/973] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:58 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:53:59.103441 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:59.104109 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:59.111468 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.111955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.112738 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.113174 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.140352 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:59.140965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:59.146986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.147431 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.148237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.148652 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.312358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:59.321317 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b9c687d9-63d4-46cb-afaa-a837ec8f857e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.225177 Jan 10 12:53:59.321914 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 473/974] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:59 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:59.326610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:59.327221 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:59.335744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:59.336067 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.336525 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.337328 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.337950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.345932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-52893400-5cb1-4e96-a29e-4967ccbf15dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.269197 Jan 10 12:53:59.346626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 502/975] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:59 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:59.417920 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:53:59.418689 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:53:59.425187 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.425675 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.426466 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:53:59.427088 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:53:59.504467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:59.513185 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4578c9af-42d6-480b-af72-3aca162399e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.190204 Jan 10 12:53:59.514534 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 474/976] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:53:59 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:53:59.576519 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:59.584522 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:59.586057 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:53:59.587215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cefa7a02-cb49-49a7-8715-f9686d1067d3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.173344 Jan 10 12:53:59.587782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 503/977] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:53:59 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:54:00.343267 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:00.344305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:00.354968 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.355821 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.357231 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.358768 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.363942 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:00.364557 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:00.371183 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.371706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.372474 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.372917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.570506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:00.575569 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:00.578442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-57129a12-abad-4c0d-83a1-7879b4681330 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.218192 Jan 10 12:54:00.579029 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 504/978] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:00 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:00.583623 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:00.584227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:00.590125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.590610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.591392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.591859 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.592697 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5832cd9a-336d-4008-8899-e4c8ba9b04d7 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.256421 Jan 10 12:54:00.603102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 475/979] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:00 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:00.608811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-7e6aa55c-fc7d-4fd8-9e6e-3facf36edfab req-d348b798-6463-4a4b-bf46-47a2c2639ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa1635d-336e-4ff1-b152-bfa017da324b", "name": "network-vif-plugged", "status": "completed", "tag": "ae828662-bdad-421c-96d6-5bded1ca3706"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:00.610439 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:54:00.610439 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:54:00.617723 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-7e6aa55c-fc7d-4fd8-9e6e-3facf36edfab req-d348b798-6463-4a4b-bf46-47a2c2639ed3 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.618480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-7e6aa55c-fc7d-4fd8-9e6e-3facf36edfab req-d348b798-6463-4a4b-bf46-47a2c2639ed3 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.630742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-7e6aa55c-fc7d-4fd8-9e6e-3facf36edfab req-d348b798-6463-4a4b-bf46-47a2c2639ed3 service nova] Creating event network-vif-plugged:ae828662-bdad-421c-96d6-5bded1ca3706 for instance aaa1635d-336e-4ff1-b152-bfa017da324b on hv-cinder-maste Jan 10 12:54:00.636045 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-7e6aa55c-fc7d-4fd8-9e6e-3facf36edfab req-d348b798-6463-4a4b-bf46-47a2c2639ed3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031319 Jan 10 12:54:00.637282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 476/980] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:00.642408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:00.643282 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:00.661253 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.661715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.662668 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:00.663115 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:00.784419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:00.795181 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-dfce8843-450f-4c64-947d-21da357021eb tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.214749 Jan 10 12:54:00.796962 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 505/981] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:00 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:00.850629 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:00.858835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:00.860467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:00.861640 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-20dca6db-ca88-49a4-b587-da83fd40243e tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.223056 Jan 10 12:54:00.862336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 477/982] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:00 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:54:01.599166 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:01.600255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:01.611662 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.612425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:01.613728 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:01.614482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.614482 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:01.614805 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:01.624463 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.624907 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:01.625688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.626115 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:01.829793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:01.831985 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:01.838277 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-549622bd-5688-42db-9b86-fc1be794072f tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.230562 Jan 10 12:54:01.838846 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 478/983] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:01 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:01.839885 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-fd59fb18-b9a3-4f7c-80ed-001b7458d57c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1363 microversion: 2.1 time: 0.246836 Jan 10 12:54:01.841416 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 506/984] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:01 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:54:01.846542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:01.847216 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:01.853764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.854153 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:01.854941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.855381 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:01.880116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:01.880831 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:01.887127 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.887617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:01.888615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:01.889057 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:02.042620 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:02.050840 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5694a015-8736-4d4b-a898-9d9e7e775023 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.210917 Jan 10 12:54:02.051729 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 479/985] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:01 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:02.078369 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:02.086501 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:02.088076 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:02.089374 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-381bc077-ecff-4d14-8523-9c2c4e2f015c tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.213007 Jan 10 12:54:02.090017 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 507/986] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:01 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:54:02.763935 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-6e6bff76-e45c-4334-ae67-3434915d224c req-17b5334b-0d96-451a-9864-379a277790e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09225d89-9a27-4364-a81c-ed60792c76f3", "name": "network-vif-plugged", "status": "completed", "tag": "dc3f0c02-667c-403b-91d3-b98ae7eeec12"}, {"server_uuid": "17ec6184-c920-4234-a9f6-5e726a1be681", "name": "network-vif-plugged", "status": "completed", "tag": "b7bcefb3-698a-4790-bca2-57d443e10d43"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:02.765660 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:54:02.765660 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:54:02.776970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-6e6bff76-e45c-4334-ae67-3434915d224c req-17b5334b-0d96-451a-9864-379a277790e8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:02.777417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-6e6bff76-e45c-4334-ae67-3434915d224c req-17b5334b-0d96-451a-9864-379a277790e8 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:02.790426 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-6e6bff76-e45c-4334-ae67-3434915d224c req-17b5334b-0d96-451a-9864-379a277790e8 service nova] Creating event network-vif-plugged:dc3f0c02-667c-403b-91d3-b98ae7eeec12 for instance 09225d89-9a27-4364-a81c-ed60792c76f3 on hv-cinder-maste Jan 10 12:54:02.790938 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-6e6bff76-e45c-4334-ae67-3434915d224c req-17b5334b-0d96-451a-9864-379a277790e8 service nova] Creating event network-vif-plugged:b7bcefb3-698a-4790-bca2-57d443e10d43 for instance 17ec6184-c920-4234-a9f6-5e726a1be681 on hv-cinder-maste Jan 10 12:54:02.797507 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-6e6bff76-e45c-4334-ae67-3434915d224c req-17b5334b-0d96-451a-9864-379a277790e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037315 Jan 10 12:54:02.798121 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 480/987] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:02.855437 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:02.856270 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:02.857820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:02.859109 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:02.863485 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:02.863988 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:02.865007 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:02.865456 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:02.865712 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:02.866211 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:02.867175 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:02.867749 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:03.090723 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:03.094885 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:03.099246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-72aa4d4f-5ac3-4c08-8801-4b1751a9863c tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.247600 Jan 10 12:54:03.099882 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 508/988] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:02 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:03.104012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ec0718c8-3dd7-475d-bbcd-b4c0efc12476 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1548 microversion: 2.1 time: 0.250335 Jan 10 12:54:03.106246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:03.107046 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:03.110438 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 481/989] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:02 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:03.114041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:03.114748 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:03.115843 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:03.116338 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:03.116556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:03.116950 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:03.123257 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:03.123777 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:03.124583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:03.125020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:03.319196 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:03.323549 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:03.327821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f33888e5-ddab-426d-920c-89ce2cd2847b tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.225084 Jan 10 12:54:03.332219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 509/990] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:03 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:03.333916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-41fb338e-9d44-4e86-ba4f-125b5a235dd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:03.334420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-41fb338e-9d44-4e86-ba4f-125b5a235dd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:03.336001 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:03.337801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:03.339090 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-931fee4e-e7cd-45f6-ad36-8c4a2f268884 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.226458 Jan 10 12:54:03.339957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 482/991] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:03 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:54:03.344240 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-41fb338e-9d44-4e86-ba4f-125b5a235dd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:03.344678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-41fb338e-9d44-4e86-ba4f-125b5a235dd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:03.345533 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-41fb338e-9d44-4e86-ba4f-125b5a235dd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:03.345945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-41fb338e-9d44-4e86-ba4f-125b5a235dd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:03.431885 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-41fb338e-9d44-4e86-ba4f-125b5a235dd4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101375 Jan 10 12:54:03.433161 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 510/992] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jan 10 12:54:03 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:04.116703 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:04.117330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:04.124976 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.125448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.126221 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.126658 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.345593 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:04.346178 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:04.352798 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.353253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.354021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.354488 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.551448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:04.568313 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c561b0f7-8e31-4efa-9e36-e9e9590b3fd3 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.455333 Jan 10 12:54:04.568888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 483/993] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:04 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:04.577056 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:04.577683 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:04.600575 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.601033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.602384 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.602829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.724641 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:04.741597 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7c8e0a48-1a2d-464e-bb32-c9a15f6fdf4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1263 microversion: 2.1 time: 0.400191 Jan 10 12:54:04.750975 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 511/994] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:04 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1263 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:04.848378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-453df7a3-2ac7-4d69-9435-0a91ccbdc8bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:04.850649 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-453df7a3-2ac7-4d69-9435-0a91ccbdc8bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:04.858148 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-453df7a3-2ac7-4d69-9435-0a91ccbdc8bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.858949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-453df7a3-2ac7-4d69-9435-0a91ccbdc8bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.860163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-453df7a3-2ac7-4d69-9435-0a91ccbdc8bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.860814 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-453df7a3-2ac7-4d69-9435-0a91ccbdc8bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.900917 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:04.910691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:04.912478 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:04.914192 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-15b3e710-5b6f-44a9-9c69-cb6404477073 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1728 microversion: 2.20 time: 0.344195 Jan 10 12:54:04.915075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 484/995] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:04 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1728 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:54:04.919882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-f60cd36e-296f-4adf-8213-806940848415 req-113fc84d-20c0-4bfa-8ddd-29e48d749c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa1635d-336e-4ff1-b152-bfa017da324b", "tag": "ae828662-bdad-421c-96d6-5bded1ca3706"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:04.921453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:54:04.921453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:54:04.924739 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-453df7a3-2ac7-4d69-9435-0a91ccbdc8bc tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.080738 Jan 10 12:54:04.925557 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 512/996] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:04 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:04.931463 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-f60cd36e-296f-4adf-8213-806940848415 req-113fc84d-20c0-4bfa-8ddd-29e48d749c11 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:04.932002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-f60cd36e-296f-4adf-8213-806940848415 req-113fc84d-20c0-4bfa-8ddd-29e48d749c11 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:04.945413 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-f60cd36e-296f-4adf-8213-806940848415 req-113fc84d-20c0-4bfa-8ddd-29e48d749c11 service nova] Creating event network-changed:ae828662-bdad-421c-96d6-5bded1ca3706 for instance aaa1635d-336e-4ff1-b152-bfa017da324b on hv-cinder-maste Jan 10 12:54:04.950836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-f60cd36e-296f-4adf-8213-806940848415 req-113fc84d-20c0-4bfa-8ddd-29e48d749c11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034375 Jan 10 12:54:04.951553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 485/997] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:05.588958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:05.589809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:05.601465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.601909 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:05.602706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.603138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:05.762688 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:05.764168 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:05.764694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:05.770588 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.771038 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:05.771867 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.772301 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:05.773765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-79edfeb3-1a71-4850-875a-5859b65c2711 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.191345 Jan 10 12:54:05.774442 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 513/998] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:05 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:05.909408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:05.917219 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6281131f-55a4-4660-911e-cc229b342dc8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1450 microversion: 2.1 time: 0.162598 Jan 10 12:54:05.917724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 486/999] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:05 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:54:05.933321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:05.934141 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:05.934283 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:05.934848 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:05.941336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.941773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:05.942836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.943295 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:05.946644 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.947102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:05.947999 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:05.948439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:06.156265 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:06.162471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:06.167024 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:06.169233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:06.170870 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-626fc117-2243-4e03-8efd-7667a07e0cab tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1715 microversion: 2.20 time: 0.241307 Jan 10 12:54:06.171669 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 487/1000] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:05 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1715 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:54:06.173105 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-86269c43-73eb-4c88-846a-78a2894e6f6f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1450 microversion: 2.1 time: 0.243751 Jan 10 12:54:06.173833 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 514/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:05 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1450 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:54:06.176024 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-73dad2ae-e65a-4846-bdc3-9caa884a420b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:06.176988 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-73dad2ae-e65a-4846-bdc3-9caa884a420b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:06.183113 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73dad2ae-e65a-4846-bdc3-9caa884a420b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:06.183602 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73dad2ae-e65a-4846-bdc3-9caa884a420b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:06.184510 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73dad2ae-e65a-4846-bdc3-9caa884a420b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:06.184955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-73dad2ae-e65a-4846-bdc3-9caa884a420b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:06.244133 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-73dad2ae-e65a-4846-bdc3-9caa884a420b tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.071149 Jan 10 12:54:06.244784 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 488/1002] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:06 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:06.791421 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:06.792055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:06.799257 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:06.799748 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:06.800616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:06.801058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:07.076445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:07.084752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-631015f5-b8e5-4b26-8b75-833dbe3acc98 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1757 microversion: 2.1 time: 0.297048 Jan 10 12:54:07.085338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 515/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:06 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1757 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:07.255886 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ccb7e83f-b2ea-4998-bf4f-2e6dc8a8a6b5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:07.256962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ccb7e83f-b2ea-4998-bf4f-2e6dc8a8a6b5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:07.264311 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ccb7e83f-b2ea-4998-bf4f-2e6dc8a8a6b5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:07.264732 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ccb7e83f-b2ea-4998-bf4f-2e6dc8a8a6b5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:07.265552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ccb7e83f-b2ea-4998-bf4f-2e6dc8a8a6b5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:07.265982 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ccb7e83f-b2ea-4998-bf4f-2e6dc8a8a6b5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:07.326951 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ccb7e83f-b2ea-4998-bf4f-2e6dc8a8a6b5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.075020 Jan 10 12:54:07.330328 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 489/1004] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:07 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:07.889379 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-eb3070cf-a84a-4ab1-a4ff-09d687e1a369 req-f946d6e0-6a18-45e4-a2e0-ec167a82a512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ec6184-c920-4234-a9f6-5e726a1be681", "tag": "b7bcefb3-698a-4790-bca2-57d443e10d43"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:07.890868 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:54:07.890868 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:54:07.899146 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-eb3070cf-a84a-4ab1-a4ff-09d687e1a369 req-f946d6e0-6a18-45e4-a2e0-ec167a82a512 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:07.899625 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-eb3070cf-a84a-4ab1-a4ff-09d687e1a369 req-f946d6e0-6a18-45e4-a2e0-ec167a82a512 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:07.911295 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-eb3070cf-a84a-4ab1-a4ff-09d687e1a369 req-f946d6e0-6a18-45e4-a2e0-ec167a82a512 service nova] Creating event network-changed:b7bcefb3-698a-4790-bca2-57d443e10d43 for instance 17ec6184-c920-4234-a9f6-5e726a1be681 on hv-cinder-maste Jan 10 12:54:07.916331 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-eb3070cf-a84a-4ab1-a4ff-09d687e1a369 req-f946d6e0-6a18-45e4-a2e0-ec167a82a512 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030522 Jan 10 12:54:07.916905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 516/1005] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:08.102473 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:08.103207 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:08.111015 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:08.111471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:08.112283 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:08.112739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:08.267542 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:08.276504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-29fc89cd-4e5f-45e9-ba0e-de2b325a8461 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1760 microversion: 2.1 time: 0.177925 Jan 10 12:54:08.277475 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 490/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:08 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:08.338731 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3cdd4671-39e3-4068-88c5-2100e5e35258 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:08.339773 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3cdd4671-39e3-4068-88c5-2100e5e35258 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:08.347136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3cdd4671-39e3-4068-88c5-2100e5e35258 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:08.347576 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3cdd4671-39e3-4068-88c5-2100e5e35258 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:08.348391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3cdd4671-39e3-4068-88c5-2100e5e35258 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:08.348821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3cdd4671-39e3-4068-88c5-2100e5e35258 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:08.416639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3cdd4671-39e3-4068-88c5-2100e5e35258 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.081818 Jan 10 12:54:08.417575 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 517/1007] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:08 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:09.430973 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f31b42e5-f6a8-4bc3-81a2-937e605b9f56 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:09.432101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f31b42e5-f6a8-4bc3-81a2-937e605b9f56 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:09.443780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f31b42e5-f6a8-4bc3-81a2-937e605b9f56 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:09.444259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f31b42e5-f6a8-4bc3-81a2-937e605b9f56 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:09.445060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f31b42e5-f6a8-4bc3-81a2-937e605b9f56 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:09.445501 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f31b42e5-f6a8-4bc3-81a2-937e605b9f56 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:09.520535 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f31b42e5-f6a8-4bc3-81a2-937e605b9f56 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.095852 Jan 10 12:54:09.521170 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 491/1008] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:09 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:10.533469 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-db6cf0f5-36ee-4add-8347-b14a25c55378 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:10.534501 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-db6cf0f5-36ee-4add-8347-b14a25c55378 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:10.541763 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db6cf0f5-36ee-4add-8347-b14a25c55378 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:10.542214 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db6cf0f5-36ee-4add-8347-b14a25c55378 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:10.542989 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db6cf0f5-36ee-4add-8347-b14a25c55378 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:10.543420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-db6cf0f5-36ee-4add-8347-b14a25c55378 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:10.606857 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-db6cf0f5-36ee-4add-8347-b14a25c55378 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.077693 Jan 10 12:54:10.607558 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 518/1009] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:10 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:11.623101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-53b1985e-9175-4d79-8737-9d0af6593fbb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:11.625008 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-53b1985e-9175-4d79-8737-9d0af6593fbb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:11.636543 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53b1985e-9175-4d79-8737-9d0af6593fbb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:11.637293 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53b1985e-9175-4d79-8737-9d0af6593fbb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:11.638605 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53b1985e-9175-4d79-8737-9d0af6593fbb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:11.639764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53b1985e-9175-4d79-8737-9d0af6593fbb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:11.705643 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-53b1985e-9175-4d79-8737-9d0af6593fbb tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.089144 Jan 10 12:54:11.706570 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 492/1010] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:11 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:12.721754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9f3f06ef-64e6-4063-8632-9b02e3a98939 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:12.723110 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9f3f06ef-64e6-4063-8632-9b02e3a98939 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:12.733238 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9f3f06ef-64e6-4063-8632-9b02e3a98939 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:12.733875 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9f3f06ef-64e6-4063-8632-9b02e3a98939 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:12.735012 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9f3f06ef-64e6-4063-8632-9b02e3a98939 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:12.735664 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9f3f06ef-64e6-4063-8632-9b02e3a98939 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:12.810502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9f3f06ef-64e6-4063-8632-9b02e3a98939 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.094599 Jan 10 12:54:12.812931 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 519/1011] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:12 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:13.828946 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2df02928-028d-4499-8a07-25b4027790a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:13.830491 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2df02928-028d-4499-8a07-25b4027790a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:13.837700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2df02928-028d-4499-8a07-25b4027790a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:13.838147 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2df02928-028d-4499-8a07-25b4027790a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:13.838921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2df02928-028d-4499-8a07-25b4027790a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:13.839349 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2df02928-028d-4499-8a07-25b4027790a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:13.903296 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2df02928-028d-4499-8a07-25b4027790a9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.081292 Jan 10 12:54:13.904052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 493/1012] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:13 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:14.918959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ebbca6a1-0bed-48f0-b889-65efdf04d529 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:14.920465 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ebbca6a1-0bed-48f0-b889-65efdf04d529 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:14.931290 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ebbca6a1-0bed-48f0-b889-65efdf04d529 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:14.932049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ebbca6a1-0bed-48f0-b889-65efdf04d529 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:14.933616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ebbca6a1-0bed-48f0-b889-65efdf04d529 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:14.934303 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ebbca6a1-0bed-48f0-b889-65efdf04d529 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:14.998600 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ebbca6a1-0bed-48f0-b889-65efdf04d529 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 14 microversion: 2.1 time: 0.085970 Jan 10 12:54:15.000903 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 520/1013] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:14 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:16.014358 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-39ee5129-97d1-42d2-8ff3-70de9029b177 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:16.016126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-39ee5129-97d1-42d2-8ff3-70de9029b177 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:16.023806 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39ee5129-97d1-42d2-8ff3-70de9029b177 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:16.024269 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39ee5129-97d1-42d2-8ff3-70de9029b177 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:16.025055 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39ee5129-97d1-42d2-8ff3-70de9029b177 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:16.025492 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-39ee5129-97d1-42d2-8ff3-70de9029b177 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:16.108031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-39ee5129-97d1-42d2-8ff3-70de9029b177 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 7294 microversion: 2.1 time: 0.100028 Jan 10 12:54:16.108999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 494/1014] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:16 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 7294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:17.126337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1b2da7cb-78d3-4d77-9c7e-9ecc17d40b8e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:17.127699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1b2da7cb-78d3-4d77-9c7e-9ecc17d40b8e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:17.135324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b2da7cb-78d3-4d77-9c7e-9ecc17d40b8e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:17.135817 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b2da7cb-78d3-4d77-9c7e-9ecc17d40b8e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:17.136611 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b2da7cb-78d3-4d77-9c7e-9ecc17d40b8e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:17.137049 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1b2da7cb-78d3-4d77-9c7e-9ecc17d40b8e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:17.212826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1b2da7cb-78d3-4d77-9c7e-9ecc17d40b8e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 15025 microversion: 2.1 time: 0.093525 Jan 10 12:54:17.213424 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 521/1015] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:17 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 15025 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:18.225316 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-7b4c6e9b-398a-4583-bbdf-cdcff3544b88 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:18.226350 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-7b4c6e9b-398a-4583-bbdf-cdcff3544b88 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:18.233573 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b4c6e9b-398a-4583-bbdf-cdcff3544b88 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:18.234018 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b4c6e9b-398a-4583-bbdf-cdcff3544b88 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:18.234791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b4c6e9b-398a-4583-bbdf-cdcff3544b88 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:18.235223 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-7b4c6e9b-398a-4583-bbdf-cdcff3544b88 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:18.311723 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-7b4c6e9b-398a-4583-bbdf-cdcff3544b88 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 17914 microversion: 2.1 time: 0.090013 Jan 10 12:54:18.312712 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 495/1016] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:18 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 17914 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 12:54:19.330603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-954c142c-c8a8-4f8b-b666-e38ce779cb0e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:19.332907 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-954c142c-c8a8-4f8b-b666-e38ce779cb0e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:19.344532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-954c142c-c8a8-4f8b-b666-e38ce779cb0e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:19.345290 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-954c142c-c8a8-4f8b-b666-e38ce779cb0e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:19.346969 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-954c142c-c8a8-4f8b-b666-e38ce779cb0e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:19.347227 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-954c142c-c8a8-4f8b-b666-e38ce779cb0e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:19.449238 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-954c142c-c8a8-4f8b-b666-e38ce779cb0e tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 19342 microversion: 2.1 time: 0.124888 Jan 10 12:54:19.450104 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 522/1017] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:19 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 19342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:20.468098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0ec8aa38-56e0-430d-8b38-530c4ff5de27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:20.469778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0ec8aa38-56e0-430d-8b38-530c4ff5de27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:20.481855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ec8aa38-56e0-430d-8b38-530c4ff5de27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:20.482591 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ec8aa38-56e0-430d-8b38-530c4ff5de27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:20.484031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ec8aa38-56e0-430d-8b38-530c4ff5de27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:20.484757 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0ec8aa38-56e0-430d-8b38-530c4ff5de27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:20.590231 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0ec8aa38-56e0-430d-8b38-530c4ff5de27 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 21519 microversion: 2.1 time: 0.128922 Jan 10 12:54:20.591246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 496/1018] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:20 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 21519 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:21.608819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ea2011b9-511b-4eb6-a9ed-1570ea1de941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:21.610529 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ea2011b9-511b-4eb6-a9ed-1570ea1de941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:21.622064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea2011b9-511b-4eb6-a9ed-1570ea1de941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:21.622821 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea2011b9-511b-4eb6-a9ed-1570ea1de941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:21.624194 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea2011b9-511b-4eb6-a9ed-1570ea1de941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:21.624914 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ea2011b9-511b-4eb6-a9ed-1570ea1de941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:21.720597 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ea2011b9-511b-4eb6-a9ed-1570ea1de941 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 22981 microversion: 2.1 time: 0.117959 Jan 10 12:54:21.721611 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 523/1019] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:21 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 22981 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:22.739281 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ddc42941-4227-4a79-aa7f-47cafb25fe0d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:22.739842 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ddc42941-4227-4a79-aa7f-47cafb25fe0d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:22.747114 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddc42941-4227-4a79-aa7f-47cafb25fe0d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:22.747582 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddc42941-4227-4a79-aa7f-47cafb25fe0d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:22.748387 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddc42941-4227-4a79-aa7f-47cafb25fe0d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:22.748819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ddc42941-4227-4a79-aa7f-47cafb25fe0d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:22.835356 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ddc42941-4227-4a79-aa7f-47cafb25fe0d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 24075 microversion: 2.1 time: 0.103430 Jan 10 12:54:22.836266 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 497/1020] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:22 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 24075 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:23.852272 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9980e60b-9591-4498-873e-c242aa1cd01d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:23.853545 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9980e60b-9591-4498-873e-c242aa1cd01d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:23.862480 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9980e60b-9591-4498-873e-c242aa1cd01d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:23.863048 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9980e60b-9591-4498-873e-c242aa1cd01d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:23.864215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9980e60b-9591-4498-873e-c242aa1cd01d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:23.864661 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9980e60b-9591-4498-873e-c242aa1cd01d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:23.954200 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9980e60b-9591-4498-873e-c242aa1cd01d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 25438 microversion: 2.1 time: 0.107316 Jan 10 12:54:23.955041 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 524/1021] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:23 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 25438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:24.973362 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2f86594b-2c0b-4499-b7cd-8f38b1c90b39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:24.974836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2f86594b-2c0b-4499-b7cd-8f38b1c90b39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:24.986434 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f86594b-2c0b-4499-b7cd-8f38b1c90b39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:24.987220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f86594b-2c0b-4499-b7cd-8f38b1c90b39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:24.988582 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f86594b-2c0b-4499-b7cd-8f38b1c90b39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:24.989309 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-2f86594b-2c0b-4499-b7cd-8f38b1c90b39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:25.087701 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2f86594b-2c0b-4499-b7cd-8f38b1c90b39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 26446 microversion: 2.1 time: 0.120652 Jan 10 12:54:25.088827 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 498/1022] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:24 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 26446 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:26.107651 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6548d656-d7f2-4730-b18e-d33159487e39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:26.109141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6548d656-d7f2-4730-b18e-d33159487e39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:26.120976 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6548d656-d7f2-4730-b18e-d33159487e39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:26.121729 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6548d656-d7f2-4730-b18e-d33159487e39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:26.123107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6548d656-d7f2-4730-b18e-d33159487e39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:26.123898 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6548d656-d7f2-4730-b18e-d33159487e39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:26.208199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6548d656-d7f2-4730-b18e-d33159487e39 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 27172 microversion: 2.1 time: 0.106915 Jan 10 12:54:26.209136 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 525/1023] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:26 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 27172 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:27.226839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d8c5af1b-16e1-4939-82bd-f155e4d317d0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:27.228226 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d8c5af1b-16e1-4939-82bd-f155e4d317d0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:27.238967 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8c5af1b-16e1-4939-82bd-f155e4d317d0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:27.239502 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8c5af1b-16e1-4939-82bd-f155e4d317d0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:27.240394 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8c5af1b-16e1-4939-82bd-f155e4d317d0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:27.240830 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d8c5af1b-16e1-4939-82bd-f155e4d317d0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:27.476054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d8c5af1b-16e1-4939-82bd-f155e4d317d0 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 27767 microversion: 2.1 time: 0.255374 Jan 10 12:54:27.476995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 499/1024] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:27 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 27767 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:28.492576 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9833f5bc-9863-444b-81d8-1d8538adbf44 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:28.493582 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9833f5bc-9863-444b-81d8-1d8538adbf44 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:28.500494 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9833f5bc-9863-444b-81d8-1d8538adbf44 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:28.500943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9833f5bc-9863-444b-81d8-1d8538adbf44 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:28.501728 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9833f5bc-9863-444b-81d8-1d8538adbf44 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:28.502151 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9833f5bc-9863-444b-81d8-1d8538adbf44 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:28.582104 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9833f5bc-9863-444b-81d8-1d8538adbf44 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28043 microversion: 2.1 time: 0.094948 Jan 10 12:54:28.582745 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 526/1025] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:28 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28043 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:29.598866 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9c693788-bdb3-457a-8a32-bd12d6f978cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:29.600963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9c693788-bdb3-457a-8a32-bd12d6f978cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:29.608344 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c693788-bdb3-457a-8a32-bd12d6f978cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:29.608791 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c693788-bdb3-457a-8a32-bd12d6f978cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:29.609568 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c693788-bdb3-457a-8a32-bd12d6f978cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:29.610002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c693788-bdb3-457a-8a32-bd12d6f978cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:29.693036 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9c693788-bdb3-457a-8a32-bd12d6f978cd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28188 microversion: 2.1 time: 0.100860 Jan 10 12:54:29.693804 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 500/1026] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:29 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:30.707841 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2cff6331-c167-45bc-b8e5-1f1c4e2c5738 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:30.709412 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2cff6331-c167-45bc-b8e5-1f1c4e2c5738 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:30.717171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2cff6331-c167-45bc-b8e5-1f1c4e2c5738 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:30.717611 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2cff6331-c167-45bc-b8e5-1f1c4e2c5738 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:30.718373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2cff6331-c167-45bc-b8e5-1f1c4e2c5738 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:30.718828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2cff6331-c167-45bc-b8e5-1f1c4e2c5738 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:30.800398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2cff6331-c167-45bc-b8e5-1f1c4e2c5738 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28316 microversion: 2.1 time: 0.098128 Jan 10 12:54:30.801037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 527/1027] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:30 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28316 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:31.817515 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6634f331-79b6-4657-8d16-dd7b91bef91c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:31.820137 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6634f331-79b6-4657-8d16-dd7b91bef91c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:31.831420 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6634f331-79b6-4657-8d16-dd7b91bef91c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:31.832215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6634f331-79b6-4657-8d16-dd7b91bef91c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:31.833492 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6634f331-79b6-4657-8d16-dd7b91bef91c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:31.834337 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6634f331-79b6-4657-8d16-dd7b91bef91c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:31.922075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6634f331-79b6-4657-8d16-dd7b91bef91c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28479 microversion: 2.1 time: 0.110852 Jan 10 12:54:31.922959 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 501/1028] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:31 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28479 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:32.940863 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3d94d935-c1eb-49ba-bb0f-a74b1f9498b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:32.942403 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3d94d935-c1eb-49ba-bb0f-a74b1f9498b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:32.950346 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d94d935-c1eb-49ba-bb0f-a74b1f9498b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:32.950808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d94d935-c1eb-49ba-bb0f-a74b1f9498b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:32.951614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d94d935-c1eb-49ba-bb0f-a74b1f9498b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:32.952058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3d94d935-c1eb-49ba-bb0f-a74b1f9498b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:33.048902 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3d94d935-c1eb-49ba-bb0f-a74b1f9498b4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28647 microversion: 2.1 time: 0.114917 Jan 10 12:54:33.049945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 528/1029] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:32 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28647 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:34.068056 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8485c775-101e-4b56-ade4-c219d446d28a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:34.069880 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8485c775-101e-4b56-ade4-c219d446d28a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:34.077102 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8485c775-101e-4b56-ade4-c219d446d28a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:34.077554 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8485c775-101e-4b56-ade4-c219d446d28a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:34.078331 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8485c775-101e-4b56-ade4-c219d446d28a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:34.078759 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8485c775-101e-4b56-ade4-c219d446d28a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:34.148509 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8485c775-101e-4b56-ade4-c219d446d28a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28647 microversion: 2.1 time: 0.086831 Jan 10 12:54:34.149355 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 502/1030] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:34 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28647 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:35.165231 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-636b73ee-0fb3-4e0b-987a-6077b67c147f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:35.166299 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-636b73ee-0fb3-4e0b-987a-6077b67c147f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:35.173725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-636b73ee-0fb3-4e0b-987a-6077b67c147f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:35.174194 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-636b73ee-0fb3-4e0b-987a-6077b67c147f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:35.174985 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-636b73ee-0fb3-4e0b-987a-6077b67c147f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:35.175422 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-636b73ee-0fb3-4e0b-987a-6077b67c147f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:35.242971 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-636b73ee-0fb3-4e0b-987a-6077b67c147f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28647 microversion: 2.1 time: 0.083893 Jan 10 12:54:35.243622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 529/1031] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:35 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28647 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:36.260244 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9b9a55a4-e928-46dd-b757-a45b7b321626 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:36.261855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9b9a55a4-e928-46dd-b757-a45b7b321626 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:36.274885 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b9a55a4-e928-46dd-b757-a45b7b321626 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:36.275335 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b9a55a4-e928-46dd-b757-a45b7b321626 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:36.276172 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b9a55a4-e928-46dd-b757-a45b7b321626 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:36.276609 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9b9a55a4-e928-46dd-b757-a45b7b321626 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:36.343770 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9b9a55a4-e928-46dd-b757-a45b7b321626 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 28647 microversion: 2.1 time: 0.090464 Jan 10 12:54:36.344604 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 503/1032] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:36 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 28647 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:37.357559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-1e9e3df7-2fbe-4d10-b610-93cebd866e67 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:37.358580 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-1e9e3df7-2fbe-4d10-b610-93cebd866e67 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:37.366133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e9e3df7-2fbe-4d10-b610-93cebd866e67 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:37.366591 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e9e3df7-2fbe-4d10-b610-93cebd866e67 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:37.367380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e9e3df7-2fbe-4d10-b610-93cebd866e67 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:37.367851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-1e9e3df7-2fbe-4d10-b610-93cebd866e67 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:37.455837 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-1e9e3df7-2fbe-4d10-b610-93cebd866e67 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 29949 microversion: 2.1 time: 0.101725 Jan 10 12:54:37.456844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 530/1033] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:37 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 29949 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:38.470028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-04fc46f4-db26-426d-b4fa-252abab302c5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:38.471031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-04fc46f4-db26-426d-b4fa-252abab302c5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:38.478483 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-04fc46f4-db26-426d-b4fa-252abab302c5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:38.478935 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-04fc46f4-db26-426d-b4fa-252abab302c5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:38.479766 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-04fc46f4-db26-426d-b4fa-252abab302c5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:38.480313 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-04fc46f4-db26-426d-b4fa-252abab302c5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:38.565620 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-04fc46f4-db26-426d-b4fa-252abab302c5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 31781 microversion: 2.1 time: 0.098733 Jan 10 12:54:38.566531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 504/1034] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:38 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 31781 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:39.581406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2c1c0070-5f40-46a0-a939-004c0ff3b9d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:39.582705 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-2c1c0070-5f40-46a0-a939-004c0ff3b9d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:39.592986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2c1c0070-5f40-46a0-a939-004c0ff3b9d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:39.593561 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2c1c0070-5f40-46a0-a939-004c0ff3b9d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:39.594551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2c1c0070-5f40-46a0-a939-004c0ff3b9d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:39.595103 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-2c1c0070-5f40-46a0-a939-004c0ff3b9d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:39.675282 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2c1c0070-5f40-46a0-a939-004c0ff3b9d5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 33266 microversion: 2.1 time: 0.098407 Jan 10 12:54:39.676325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 531/1035] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:39 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 33266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:40.689774 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-743638d8-b6c6-4358-aaae-34ce1db69c06 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:40.690764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-743638d8-b6c6-4358-aaae-34ce1db69c06 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:40.698284 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-743638d8-b6c6-4358-aaae-34ce1db69c06 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:40.698730 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-743638d8-b6c6-4358-aaae-34ce1db69c06 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:40.699531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-743638d8-b6c6-4358-aaae-34ce1db69c06 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:40.699968 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-743638d8-b6c6-4358-aaae-34ce1db69c06 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:40.782675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-743638d8-b6c6-4358-aaae-34ce1db69c06 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 34058 microversion: 2.1 time: 0.096506 Jan 10 12:54:40.783591 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 505/1036] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:40 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 34058 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:41.801361 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4ef91d75-104d-42ab-842e-5aa36d038b13 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:41.803061 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4ef91d75-104d-42ab-842e-5aa36d038b13 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:41.814555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ef91d75-104d-42ab-842e-5aa36d038b13 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:41.815310 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ef91d75-104d-42ab-842e-5aa36d038b13 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:41.816695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ef91d75-104d-42ab-842e-5aa36d038b13 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:41.817425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ef91d75-104d-42ab-842e-5aa36d038b13 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:41.902549 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4ef91d75-104d-42ab-842e-5aa36d038b13 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 34964 microversion: 2.1 time: 0.107604 Jan 10 12:54:41.903591 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 532/1037] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:41 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 34964 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:42.921735 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bcb4775c-60f6-4890-812a-ef1062ed653d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:42.923285 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bcb4775c-60f6-4890-812a-ef1062ed653d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:42.933656 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcb4775c-60f6-4890-812a-ef1062ed653d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:42.934111 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcb4775c-60f6-4890-812a-ef1062ed653d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:42.934897 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcb4775c-60f6-4890-812a-ef1062ed653d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:42.935334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bcb4775c-60f6-4890-812a-ef1062ed653d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:43.016478 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bcb4775c-60f6-4890-812a-ef1062ed653d tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 36220 microversion: 2.1 time: 0.101834 Jan 10 12:54:43.017122 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 506/1038] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:42 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 36220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:44.035686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e460e6fa-56bc-4dab-9c3d-cdae18f02ab4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:44.037194 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e460e6fa-56bc-4dab-9c3d-cdae18f02ab4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:44.045497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e460e6fa-56bc-4dab-9c3d-cdae18f02ab4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:44.045959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e460e6fa-56bc-4dab-9c3d-cdae18f02ab4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:44.046744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e460e6fa-56bc-4dab-9c3d-cdae18f02ab4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:44.047192 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e460e6fa-56bc-4dab-9c3d-cdae18f02ab4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:44.124183 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e460e6fa-56bc-4dab-9c3d-cdae18f02ab4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 37592 microversion: 2.1 time: 0.095542 Jan 10 12:54:44.124861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 533/1039] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:44 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 37592 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:45.141566 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-52dd8123-b287-48cf-a388-3bc0d99e15ec tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:45.143194 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-52dd8123-b287-48cf-a388-3bc0d99e15ec tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:45.154097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52dd8123-b287-48cf-a388-3bc0d99e15ec tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.154549 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52dd8123-b287-48cf-a388-3bc0d99e15ec tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.155333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52dd8123-b287-48cf-a388-3bc0d99e15ec tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.155811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52dd8123-b287-48cf-a388-3bc0d99e15ec tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.245396 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-52dd8123-b287-48cf-a388-3bc0d99e15ec tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 38177 microversion: 2.1 time: 0.110424 Jan 10 12:54:45.246281 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 507/1040] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:45 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 38177 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:45.594101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-28c344b4-a028-4377-8ca5-320c0bc718d9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:45.595116 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-28c344b4-a028-4377-8ca5-320c0bc718d9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:45.602388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-28c344b4-a028-4377-8ca5-320c0bc718d9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.602846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-28c344b4-a028-4377-8ca5-320c0bc718d9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.603662 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-28c344b4-a028-4377-8ca5-320c0bc718d9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.604103 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-28c344b4-a028-4377-8ca5-320c0bc718d9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.634508 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-28c344b4-a028-4377-8ca5-320c0bc718d9 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044917 Jan 10 12:54:45.635072 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 534/1041] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jan 10 12:54:45 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:54:45.700552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:45.701144 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:45.708596 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.709047 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.709842 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.710287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.738627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:54:45.819485 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9458842f-a390-4fb7-aef9-9a14a84b09b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 204 len: 0 microversion: 2.20 time: 0.122679 Jan 10 12:54:45.820344 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 508/1042] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jan 10 12:54:45 2022] DELETE /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 10 12:54:45.828345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:45.828991 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:45.835558 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.836021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.836814 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:45.837257 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:45.979887 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:45.988688 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:45.990207 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:45.991388 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4ffa0e47-9351-4161-ab5d-3f4ff2e5afa1 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.166841 Jan 10 12:54:45.992002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 535/1043] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:45 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 12:54:46.263088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-502c5e64-947b-41e7-8f97-e3fa14375043 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:46.264143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-502c5e64-947b-41e7-8f97-e3fa14375043 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:46.271739 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-502c5e64-947b-41e7-8f97-e3fa14375043 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:46.272217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-502c5e64-947b-41e7-8f97-e3fa14375043 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:46.272984 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-502c5e64-947b-41e7-8f97-e3fa14375043 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:46.273431 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-502c5e64-947b-41e7-8f97-e3fa14375043 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:46.338496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-502c5e64-947b-41e7-8f97-e3fa14375043 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 38177 microversion: 2.1 time: 0.081836 Jan 10 12:54:46.339135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 509/1044] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:46 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 38177 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:47.013722 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:47.014411 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:47.022769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:47.023341 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:47.024368 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:47.024925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:47.175594 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:47.184398 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:47.185913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:47.187097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-813a8f03-29e5-4fda-a685-62348d085483 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1721 microversion: 2.20 time: 0.180102 Jan 10 12:54:47.187694 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 536/1045] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:47 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:54:47.356810 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f6a5bcfd-9265-46c8-aa34-39ccf1545771 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:47.358366 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f6a5bcfd-9265-46c8-aa34-39ccf1545771 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:47.369811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6a5bcfd-9265-46c8-aa34-39ccf1545771 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:47.370564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6a5bcfd-9265-46c8-aa34-39ccf1545771 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:47.371841 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6a5bcfd-9265-46c8-aa34-39ccf1545771 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:47.372291 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f6a5bcfd-9265-46c8-aa34-39ccf1545771 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:47.440669 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f6a5bcfd-9265-46c8-aa34-39ccf1545771 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 38177 microversion: 2.1 time: 0.090771 Jan 10 12:54:47.441564 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 510/1046] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:47 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 38177 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:47.915138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1053222225"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:47.915699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:47.923039 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:47.923486 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:47.924472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:47.924907 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.060082 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.network.security_group_api [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Removing security group af0a998d-eb25-457e-9bb3-1752e581a4d1 from port 9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 Jan 10 12:54:48.213259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:48.214396 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:48.222228 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.222650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.223753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.224199 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.429270 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:48.443145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:48.444930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c5ac449d0494ab585c0aeccb9541016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4be23531f9014bfebfd2d51c8502d6ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:48.448023 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-47cd9a69-402e-451e-9192-b65fb903d6c0 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 200 len: 1653 microversion: 2.20 time: 0.239238 Jan 10 12:54:48.462785 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 511/1047] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:48 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 1653 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 12:54:48.473098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-92313e68-26e3-46ab-bd54-f15b4cf5f46e req-b0543c93-02b5-4e2f-be22-1bddd8993aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09225d89-9a27-4364-a81c-ed60792c76f3", "name": "network-vif-deleted", "tag": "dc3f0c02-667c-403b-91d3-b98ae7eeec12"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:48.477003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:54:48.477003 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:54:48.492557 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-92313e68-26e3-46ab-bd54-f15b4cf5f46e req-b0543c93-02b5-4e2f-be22-1bddd8993aeb service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.495598 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-92313e68-26e3-46ab-bd54-f15b4cf5f46e req-b0543c93-02b5-4e2f-be22-1bddd8993aeb service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.510913 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-92313e68-26e3-46ab-bd54-f15b4cf5f46e req-b0543c93-02b5-4e2f-be22-1bddd8993aeb service nova] Creating event network-vif-deleted:dc3f0c02-667c-403b-91d3-b98ae7eeec12 for instance 09225d89-9a27-4364-a81c-ed60792c76f3 on hv-cinder-maste Jan 10 12:54:48.543406 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-92313e68-26e3-46ab-bd54-f15b4cf5f46e req-b0543c93-02b5-4e2f-be22-1bddd8993aeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079095 Jan 10 12:54:48.547622 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 512/1048] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:48.554835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-be5940bf-3603-489d-8311-2fcfeb07a2ef tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:48.560770 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-be5940bf-3603-489d-8311-2fcfeb07a2ef tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:48.569071 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-be5940bf-3603-489d-8311-2fcfeb07a2ef tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.569648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-be5940bf-3603-489d-8311-2fcfeb07a2ef tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.570579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-be5940bf-3603-489d-8311-2fcfeb07a2ef tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.571016 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-be5940bf-3603-489d-8311-2fcfeb07a2ef tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.653928 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-be5940bf-3603-489d-8311-2fcfeb07a2ef tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action" status: 200 len: 38308 microversion: 2.1 time: 0.103570 Jan 10 12:54:48.659904 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 513/1049] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:48 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/action => generated 38308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 12:54:48.673864 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-27fb12ca-c33a-46d6-a1b8-24709adaa912 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:48.675094 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-27fb12ca-c33a-46d6-a1b8-24709adaa912 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:48.675212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f800331f-847a-48b8-a52e-b0ae4e5767d5 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/action" status: 202 len: 0 microversion: 2.1 time: 0.763905 Jan 10 12:54:48.675863 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 537/1050] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:54:47 2022] POST /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/action => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:54:48.690163 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-6dc30ece-9c89-41c8-83d9-f15ae9d7f7c2 req-8a7b7574-d012-48de-90cd-36f69f17373a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5478e592-7324-4bd6-9745-c968db315d5c", "tag": "9ec4c725-d55d-40fa-a18c-f94c61bcb3b4"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:48.692002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:54:48.692002 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:54:48.705904 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27fb12ca-c33a-46d6-a1b8-24709adaa912 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.706316 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27fb12ca-c33a-46d6-a1b8-24709adaa912 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.711178 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6dc30ece-9c89-41c8-83d9-f15ae9d7f7c2 req-8a7b7574-d012-48de-90cd-36f69f17373a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.711553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27fb12ca-c33a-46d6-a1b8-24709adaa912 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:48.711686 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-6dc30ece-9c89-41c8-83d9-f15ae9d7f7c2 req-8a7b7574-d012-48de-90cd-36f69f17373a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.712022 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-27fb12ca-c33a-46d6-a1b8-24709adaa912 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:48.742663 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-6dc30ece-9c89-41c8-83d9-f15ae9d7f7c2 req-8a7b7574-d012-48de-90cd-36f69f17373a service nova] Creating event network-changed:9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 for instance 5478e592-7324-4bd6-9745-c968db315d5c on hv-cinder-maste Jan 10 12:54:48.752562 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-6dc30ece-9c89-41c8-83d9-f15ae9d7f7c2 req-8a7b7574-d012-48de-90cd-36f69f17373a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066885 Jan 10 12:54:48.758087 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 538/1051] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:48.773859 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-27fb12ca-c33a-46d6-a1b8-24709adaa912 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/ips" status: 200 len: 144 microversion: 2.1 time: 0.112017 Jan 10 12:54:48.781724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 514/1052] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jan 10 12:54:48 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/ips => generated 144 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:49.470715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:49.471603 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:49.479202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:49.479835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:49.480844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:49.481286 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:49.497555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] HTTP exception thrown: Instance 09225d89-9a27-4364-a81c-ed60792c76f3 could not be found. Jan 10 12:54:49.498168 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Returning 404 to user: Instance 09225d89-9a27-4364-a81c-ed60792c76f3 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:49.499014 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-69f87b64-ba4f-4640-9870-478de67f9854 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 404 len: 111 microversion: 2.20 time: 0.032643 Jan 10 12:54:49.503017 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 539/1053] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:49 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 10 12:54:49.507873 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-26772619-65c0-4d9b-ba6c-ef77b246c784 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '.version_select at 0x7f7fca636310>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:49.527244 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-26772619-65c0-4d9b-ba6c-ef77b246c784 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-345082850" status: 204 len: 0 microversion: 2.20 time: 0.022977 Jan 10 12:54:49.528247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 515/1054] 10.222.0.13 () {60 vars in 1258 bytes} [Mon Jan 10 12:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-345082850 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 10 12:54:50.224084 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bcc68bef-cc89-4033-abea-e94f9bac8976 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26a30fad-8e7d-427e-8338-18ee9f162356"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:50.225138 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bcc68bef-cc89-4033-abea-e94f9bac8976 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:50.232029 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcc68bef-cc89-4033-abea-e94f9bac8976 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:50.232473 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcc68bef-cc89-4033-abea-e94f9bac8976 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:50.233230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcc68bef-cc89-4033-abea-e94f9bac8976 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:50.233665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcc68bef-cc89-4033-abea-e94f9bac8976 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:50.455064 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:50.455961 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:50.463879 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:50.464710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:50.465823 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:50.466480 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:50.496470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bcc68bef-cc89-4033-abea-e94f9bac8976 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276119 Jan 10 12:54:50.497719 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 540/1055] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:54:50 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:50.573745 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lazy-loading 'services' on Instance uuid 5478e592-7324-4bd6-9745-c968db315d5c {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:54:50.665756 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5752ff51-f951-4e4f-ad70-d13d47738925 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments/0a0d875c-5478-459c-a42d-d13404b8e449" status: 202 len: 0 microversion: 2.1 time: 0.214486 Jan 10 12:54:50.668274 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 516/1056] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:54:50 2022] DELETE /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments/0a0d875c-5478-459c-a42d-d13404b8e449 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:54:50.685489 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bddefccb-7d54-413d-9d79-dcb6bc2e1736 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:50.688611 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bddefccb-7d54-413d-9d79-dcb6bc2e1736 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:50.708735 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bddefccb-7d54-413d-9d79-dcb6bc2e1736 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:50.709815 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bddefccb-7d54-413d-9d79-dcb6bc2e1736 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:50.711682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bddefccb-7d54-413d-9d79-dcb6bc2e1736 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:50.712937 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bddefccb-7d54-413d-9d79-dcb6bc2e1736 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:50.748403 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bddefccb-7d54-413d-9d79-dcb6bc2e1736 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076496 Jan 10 12:54:50.749215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 541/1057] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:50 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:50.775906 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-218116f9-953b-4aa1-9916-fae8ecf8bdca req-ce647d87-6e77-484d-8383-0a2824b1d8ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5478e592-7324-4bd6-9745-c968db315d5c", "tag": "9ec4c725-d55d-40fa-a18c-f94c61bcb3b4"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:50.777650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:54:50.777650 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:54:50.785577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-218116f9-953b-4aa1-9916-fae8ecf8bdca req-ce647d87-6e77-484d-8383-0a2824b1d8ee service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:50.786016 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-218116f9-953b-4aa1-9916-fae8ecf8bdca req-ce647d87-6e77-484d-8383-0a2824b1d8ee service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:50.797433 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-218116f9-953b-4aa1-9916-fae8ecf8bdca req-ce647d87-6e77-484d-8383-0a2824b1d8ee service nova] Creating event network-changed:9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 for instance 5478e592-7324-4bd6-9745-c968db315d5c on hv-cinder-maste Jan 10 12:54:50.802965 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-218116f9-953b-4aa1-9916-fae8ecf8bdca req-ce647d87-6e77-484d-8383-0a2824b1d8ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030998 Jan 10 12:54:50.803599 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 517/1058] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:54:51.760981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-6756fbfe-6a71-438d-9a09-e70a05bee226 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:51.761905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-6756fbfe-6a71-438d-9a09-e70a05bee226 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:51.769037 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6756fbfe-6a71-438d-9a09-e70a05bee226 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:51.769492 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6756fbfe-6a71-438d-9a09-e70a05bee226 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:51.770281 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6756fbfe-6a71-438d-9a09-e70a05bee226 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:51.770716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-6756fbfe-6a71-438d-9a09-e70a05bee226 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:51.802117 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-6756fbfe-6a71-438d-9a09-e70a05bee226 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Jan 10 12:54:51.805535 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 542/1059] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:51 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:51.813115 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:51.813696 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:51.820365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:51.820814 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:51.821583 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:51.822012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:51.835145 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] HTTP exception thrown: Instance 09225d89-9a27-4364-a81c-ed60792c76f3 could not be found. Jan 10 12:54:51.835780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Returning 404 to user: Instance 09225d89-9a27-4364-a81c-ed60792c76f3 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:51.836612 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-01a426af-d62c-4754-a469-ef24e9dfbb63 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 404 len: 111 microversion: 2.20 time: 0.029699 Jan 10 12:54:51.837142 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 518/1060] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jan 10 12:54:51 2022] DELETE /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:54:51.845353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:51.845956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 09225d89-9a27-4364-a81c-ed60792c76f3] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:51.852432 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:51.852858 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:51.853671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:51.854134 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:51.868420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] HTTP exception thrown: Instance 09225d89-9a27-4364-a81c-ed60792c76f3 could not be found. Jan 10 12:54:51.869018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Returning 404 to user: Instance 09225d89-9a27-4364-a81c-ed60792c76f3 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:51.869847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8f007a5b-bc22-4ebd-b241-9626fbfaa21f tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3" status: 404 len: 111 microversion: 2.20 time: 0.028268 Jan 10 12:54:51.870389 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 543/1061] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:51 2022] GET /compute/v2.1/servers/09225d89-9a27-4364-a81c-ed60792c76f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:54:52.817084 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e7a47039-8969-4ea6-bfe7-935b77b26afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:52.818408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e7a47039-8969-4ea6-bfe7-935b77b26afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:52.827333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e7a47039-8969-4ea6-bfe7-935b77b26afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:52.827836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e7a47039-8969-4ea6-bfe7-935b77b26afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:52.828619 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e7a47039-8969-4ea6-bfe7-935b77b26afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:52.829064 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e7a47039-8969-4ea6-bfe7-935b77b26afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:52.864720 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e7a47039-8969-4ea6-bfe7-935b77b26afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052970 Jan 10 12:54:52.865203 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 519/1062] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:52 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:53.011006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:53.011772 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:53.019235 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:53.019715 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:53.020489 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:53.020913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:53.035476 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] HTTP exception thrown: Instance 3436ba09-022f-4b36-987d-667c236d68d1 could not be found. Jan 10 12:54:53.036102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Returning 404 to user: Instance 3436ba09-022f-4b36-987d-667c236d68d1 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:53.036915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-00c40b1e-902c-48a6-b305-3e25346082b3 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 404 len: 111 microversion: 2.20 time: 0.030991 Jan 10 12:54:53.037446 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 544/1063] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jan 10 12:54:53 2022] DELETE /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:54:53.045561 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:53.046173 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] [instance: 3436ba09-022f-4b36-987d-667c236d68d1] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:53.052448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:53.052910 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:53.053686 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:53.054121 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:53.068323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] HTTP exception thrown: Instance 3436ba09-022f-4b36-987d-667c236d68d1 could not be found. Jan 10 12:54:53.068937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] Returning 404 to user: Instance 3436ba09-022f-4b36-987d-667c236d68d1 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:53.069757 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3bf8918d-a1b9-4b7a-8f44-b5621590f3f6 tempest-AttachVolumeShelveTestJSON-1561677090 tempest-AttachVolumeShelveTestJSON-1561677090-project] 10.222.0.13 "GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1" status: 404 len: 111 microversion: 2.20 time: 0.028061 Jan 10 12:54:53.070289 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 520/1064] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jan 10 12:54:53 2022] GET /compute/v2.1/servers/3436ba09-022f-4b36-987d-667c236d68d1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:54:53.876733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-362629b0-9855-4a97-805e-18a5027f6534 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:53.877682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-362629b0-9855-4a97-805e-18a5027f6534 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:53.884619 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-362629b0-9855-4a97-805e-18a5027f6534 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:53.885078 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-362629b0-9855-4a97-805e-18a5027f6534 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:53.885881 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-362629b0-9855-4a97-805e-18a5027f6534 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:53.886322 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-362629b0-9855-4a97-805e-18a5027f6534 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:53.928179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-362629b0-9855-4a97-805e-18a5027f6534 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055265 Jan 10 12:54:53.928750 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 545/1065] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:53 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:54:54.940303 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e9a33c2a-8b82-4adc-8bf8-d2125bfff174 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:54.941197 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e9a33c2a-8b82-4adc-8bf8-d2125bfff174 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:54.947962 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e9a33c2a-8b82-4adc-8bf8-d2125bfff174 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:54.948405 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e9a33c2a-8b82-4adc-8bf8-d2125bfff174 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:54.949274 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e9a33c2a-8b82-4adc-8bf8-d2125bfff174 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:54.949970 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e9a33c2a-8b82-4adc-8bf8-d2125bfff174 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:54.981573 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e9a33c2a-8b82-4adc-8bf8-d2125bfff174 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Jan 10 12:54:54.982130 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 521/1066] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:54 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:55.993325 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-90d5a6ac-4728-40de-b41f-1f75bba11146 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:55.994253 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-90d5a6ac-4728-40de-b41f-1f75bba11146 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:56.001752 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90d5a6ac-4728-40de-b41f-1f75bba11146 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:56.002195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90d5a6ac-4728-40de-b41f-1f75bba11146 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:56.002987 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90d5a6ac-4728-40de-b41f-1f75bba11146 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:56.003420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-90d5a6ac-4728-40de-b41f-1f75bba11146 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:56.034237 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-90d5a6ac-4728-40de-b41f-1f75bba11146 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Jan 10 12:54:56.035106 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 546/1067] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:55 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:57.046908 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9e70aeb8-9c0e-49e5-9faf-4f65e2687782 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:57.048002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9e70aeb8-9c0e-49e5-9faf-4f65e2687782 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:57.054484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e70aeb8-9c0e-49e5-9faf-4f65e2687782 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:57.055220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e70aeb8-9c0e-49e5-9faf-4f65e2687782 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:57.056088 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e70aeb8-9c0e-49e5-9faf-4f65e2687782 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:57.057101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9e70aeb8-9c0e-49e5-9faf-4f65e2687782 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:57.088018 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9e70aeb8-9c0e-49e5-9faf-4f65e2687782 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045547 Jan 10 12:54:57.088727 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 522/1068] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:57 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:57.984704 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-82d5657f-a26e-4d7e-9214-abb8b98e20f9 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Action: 'create', calling method: .version_select at 0x7f7fca7d9ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-411287928", "metadata": {"Type": "work"}}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:57.986111 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-82d5657f-a26e-4d7e-9214-abb8b98e20f9 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:57.986922 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-82d5657f-a26e-4d7e-9214-abb8b98e20f9 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145839 Jan 10 12:54:57.991905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 547/1069] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jan 10 12:54:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:54:57.998191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cff35be4-64e5-4c4b-b22c-c292060d66c2 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Action: 'create', calling method: .version_select at 0x7f7fca6ce700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2136657576", "metadata": {"Type": "work"}}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:57.999753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cff35be4-64e5-4c4b-b22c-c292060d66c2 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:58.000671 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cff35be4-64e5-4c4b-b22c-c292060d66c2 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007347 Jan 10 12:54:58.001286 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 523/1070] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jan 10 12:54:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:54:58.010124 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c8376460-8f7d-444e-bbf5-649f1361a71a tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Action: 'create', calling method: .version_select at 0x7f7fca6dddc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1601361521", "metadata": {"Type": "work"}}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:58.011330 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c8376460-8f7d-444e-bbf5-649f1361a71a tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:58.012273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c8376460-8f7d-444e-bbf5-649f1361a71a tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005831 Jan 10 12:54:58.012925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 548/1071] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jan 10 12:54:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 12:54:58.021636 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-36085773-088f-478c-873c-9b7738efc8b5 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Calling method '.version_select at 0x7f7fca6eee50>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:58.031056 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bf5501a5-42d5-45b8-9f98-6b58925ed7a4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:58.032186 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bf5501a5-42d5-45b8-9f98-6b58925ed7a4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:58.038263 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bf5501a5-42d5-45b8-9f98-6b58925ed7a4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.038719 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bf5501a5-42d5-45b8-9f98-6b58925ed7a4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.039503 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bf5501a5-42d5-45b8-9f98-6b58925ed7a4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.039963 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bf5501a5-42d5-45b8-9f98-6b58925ed7a4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.048196 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-36085773-088f-478c-873c-9b7738efc8b5 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] HTTP exception thrown: Volume tempest-invalid-2104791441 could not be found. Jan 10 12:54:58.048801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-36085773-088f-478c-873c-9b7738efc8b5 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Returning 404 to user: Volume tempest-invalid-2104791441 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:58.049634 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-36085773-088f-478c-873c-9b7738efc8b5 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2104791441" status: 404 len: 99 microversion: 2.1 time: 0.031631 Jan 10 12:54:58.050176 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 524/1072] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jan 10 12:54:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2104791441 => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 10 12:54:58.060890 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-50d71d7d-e720-43d1-9f0c-a78734a6362f tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004582 Jan 10 12:54:58.061412 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 525/1073] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jan 10 12:54:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 10 12:54:58.069823 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0ff90bd5-52bd-434f-8192-f1f94d0c54e1 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003432 Jan 10 12:54:58.070931 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 526/1074] 10.222.0.13 () {58 vars in 1136 bytes} [Mon Jan 10 12:54:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 10 12:54:58.071171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bf5501a5-42d5-45b8-9f98-6b58925ed7a4 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Jan 10 12:54:58.071770 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 549/1075] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:58 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:54:58.079374 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b43713ba-b060-4234-bd26-07a30af49158 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Calling method '.version_select at 0x7f7fca71a940>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:58.081561 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5a514fcb-05ee-4a4e-8c10-a2c3821a3d81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:58.082066 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5a514fcb-05ee-4a4e-8c10-a2c3821a3d81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:58.088070 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a514fcb-05ee-4a4e-8c10-a2c3821a3d81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.088524 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a514fcb-05ee-4a4e-8c10-a2c3821a3d81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.089337 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a514fcb-05ee-4a4e-8c10-a2c3821a3d81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.089785 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5a514fcb-05ee-4a4e-8c10-a2c3821a3d81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.105859 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-b43713ba-b060-4234-bd26-07a30af49158 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] HTTP exception thrown: Volume ce20e2ba-e1b0-4605-b351-87e561e89dfb could not be found. Jan 10 12:54:58.106702 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b43713ba-b060-4234-bd26-07a30af49158 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Returning 404 to user: Volume ce20e2ba-e1b0-4605-b351-87e561e89dfb could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:58.107579 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b43713ba-b060-4234-bd26-07a30af49158 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ce20e2ba-e1b0-4605-b351-87e561e89dfb" status: 404 len: 109 microversion: 2.1 time: 0.031743 Jan 10 12:54:58.108129 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 527/1076] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jan 10 12:54:58 2022] DELETE /compute/v2.1/os-volumes/ce20e2ba-e1b0-4605-b351-87e561e89dfb => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 12:54:58.117279 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5c797005-8047-4e03-9e16-b8fd78db333e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:58.118251 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5c797005-8047-4e03-9e16-b8fd78db333e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:58.118939 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5a514fcb-05ee-4a4e-8c10-a2c3821a3d81 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/26a30fad-8e7d-427e-8338-18ee9f162356" status: 200 len: 194 microversion: 2.1 time: 0.040940 Jan 10 12:54:58.123933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 550/1077] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jan 10 12:54:58 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/26a30fad-8e7d-427e-8338-18ee9f162356 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:54:58.124672 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-80fd7054-9c0c-4f97-9e1b-e493897c8015 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Calling method '.version_select at 0x7f7fca68e820>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:58.126811 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c797005-8047-4e03-9e16-b8fd78db333e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.127276 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c797005-8047-4e03-9e16-b8fd78db333e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.128092 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c797005-8047-4e03-9e16-b8fd78db333e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.128544 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5c797005-8047-4e03-9e16-b8fd78db333e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.154420 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-80fd7054-9c0c-4f97-9e1b-e493897c8015 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] HTTP exception thrown: Volume abe62c45-5e18-4b54-911d-49bade9f5cf9 could not be found. Jan 10 12:54:58.155212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-80fd7054-9c0c-4f97-9e1b-e493897c8015 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] Returning 404 to user: Volume abe62c45-5e18-4b54-911d-49bade9f5cf9 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:58.156288 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-80fd7054-9c0c-4f97-9e1b-e493897c8015 tempest-VolumesNegativeTest-705558262 tempest-VolumesNegativeTest-705558262-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/abe62c45-5e18-4b54-911d-49bade9f5cf9" status: 404 len: 109 microversion: 2.1 time: 0.035848 Jan 10 12:54:58.157084 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 551/1078] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:54:58 2022] GET /compute/v2.1/os-volumes/abe62c45-5e18-4b54-911d-49bade9f5cf9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:54:58.160377 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5c797005-8047-4e03-9e16-b8fd78db333e tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046283 Jan 10 12:54:58.160377 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 528/1079] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:54:58 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:54:58.170819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:58.171316 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:58.179449 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.179933 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.180711 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:58.181375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:58.256921 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] HTTP exception thrown: Instance 5478e592-7324-4bd6-9745-c968db315d5c is not attached to volume 0a0d875c-5478-459c-a42d-d13404b8e449 Jan 10 12:54:58.258303 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Returning 404 to user: Instance 5478e592-7324-4bd6-9745-c968db315d5c is not attached to volume 0a0d875c-5478-459c-a42d-d13404b8e449 {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:54:58.259242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-22e1ab7f-4371-440a-b799-e095e793beac tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments/0a0d875c-5478-459c-a42d-d13404b8e449" status: 404 len: 154 microversion: 2.1 time: 0.093167 Jan 10 12:54:58.263312 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 552/1080] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:54:58 2022] DELETE /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c/os-volume_attachments/0a0d875c-5478-459c-a42d-d13404b8e449 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:54:59.416078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:59.416607 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:59.423780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:59.423780 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:59.424525 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:59.424995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:59.450876 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:54:59.479826 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-87ed5fc4-ca8f-47a2-99a4-0650138797dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11b4a1bf-d032-4513-b5a9-8b8cc4fdd4ce"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:54:59.481304 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-87ed5fc4-ca8f-47a2-99a4-0650138797dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:59.487708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-87ed5fc4-ca8f-47a2-99a4-0650138797dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:59.488157 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-87ed5fc4-ca8f-47a2-99a4-0650138797dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:59.488968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-87ed5fc4-ca8f-47a2-99a4-0650138797dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:59.489370 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-87ed5fc4-ca8f-47a2-99a4-0650138797dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:59.536658 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-49cfeed4-5cdc-46d1-b070-66f2f1a81405 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 204 len: 0 microversion: 2.1 time: 0.124108 Jan 10 12:54:59.539296 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 529/1081] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:54:59 2022] DELETE /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 10 12:54:59.548167 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:54:59.549337 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:54:59.557225 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:59.557989 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:59.559096 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:54:59.559843 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:54:59.706836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:54:59.715644 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-200c5d96-c75a-486a-8125-8aecf0eb1afd tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1555 microversion: 2.1 time: 0.170630 Jan 10 12:54:59.716318 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 530/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:54:59 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:54:59.754143 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-87ed5fc4-ca8f-47a2-99a4-0650138797dd tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278109 Jan 10 12:54:59.755306 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 553/1083] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jan 10 12:54:59 2022] POST /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:00.733957 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:00.735229 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:00.741328 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:00.742025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:00.743193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:00.743728 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:00.903891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:00.911555 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-f1935d24-e75b-4fc3-a3c8-afe48eb29597 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1555 microversion: 2.1 time: 0.181851 Jan 10 12:55:00.912138 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 531/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:00 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:01.837780 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-78b9c248-12de-4cb9-bb6e-98d58174e22b req-1092007d-61f0-4da8-9fb6-780e4b8c154f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5478e592-7324-4bd6-9745-c968db315d5c", "name": "network-vif-deleted", "tag": "9ec4c725-d55d-40fa-a18c-f94c61bcb3b4"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:01.841744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:55:01.841744 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:55:01.851747 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-78b9c248-12de-4cb9-bb6e-98d58174e22b req-1092007d-61f0-4da8-9fb6-780e4b8c154f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:01.852241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-78b9c248-12de-4cb9-bb6e-98d58174e22b req-1092007d-61f0-4da8-9fb6-780e4b8c154f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:01.864362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-78b9c248-12de-4cb9-bb6e-98d58174e22b req-1092007d-61f0-4da8-9fb6-780e4b8c154f service nova] Creating event network-vif-deleted:9ec4c725-d55d-40fa-a18c-f94c61bcb3b4 for instance 5478e592-7324-4bd6-9745-c968db315d5c on hv-cinder-maste Jan 10 12:55:01.869769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-78b9c248-12de-4cb9-bb6e-98d58174e22b req-1092007d-61f0-4da8-9fb6-780e4b8c154f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036468 Jan 10 12:55:01.870472 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 554/1085] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:01.928605 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:01.929227 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:01.936159 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:01.936610 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:01.937408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:01.938074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:01.973698 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:01.974442 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:01.975031 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lazy-loading 'fault' on Instance uuid 5478e592-7324-4bd6-9745-c968db315d5c {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:55:02.019068 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd08123ff9041c099577fd755b432fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b93adb02f6421e98d26e140bc17634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:02.026571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-730b140b-3baf-45d1-95ef-92c96aba9190 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 200 len: 1348 microversion: 2.1 time: 0.101549 Jan 10 12:55:02.036250 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 532/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:01 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:03.045013 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:03.045775 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] [instance: 5478e592-7324-4bd6-9745-c968db315d5c] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:03.052514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:03.052969 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:03.053765 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:03.054205 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:03.068270 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] HTTP exception thrown: Instance 5478e592-7324-4bd6-9745-c968db315d5c could not be found. Jan 10 12:55:03.068910 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Returning 404 to user: Instance 5478e592-7324-4bd6-9745-c968db315d5c could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:55:03.069750 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cf7329bd-dc1a-4e85-b091-fdd9fc9420a0 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c" status: 404 len: 111 microversion: 2.1 time: 0.029785 Jan 10 12:55:03.070290 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 555/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:03 2022] GET /compute/v2.1/servers/5478e592-7324-4bd6-9745-c968db315d5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:03.078587 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-3b7eb968-8122-436e-836e-ed8347ca5e81 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] Calling method '.version_select at 0x7f7fca636af0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:03.097159 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-3b7eb968-8122-436e-836e-ed8347ca5e81 tempest-TestMinimumBasicScenario-494946186 tempest-TestMinimumBasicScenario-494946186-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2063002998" status: 202 len: 0 microversion: 2.1 time: 0.022227 Jan 10 12:55:03.097734 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 533/1088] 10.222.0.13 () {58 vars in 1271 bytes} [Mon Jan 10 12:55:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2063002998 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:55:07.383551 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-767213dc-2d92-4251-a36f-50afeaaf634f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:07.385413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-767213dc-2d92-4251-a36f-50afeaaf634f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:07.397607 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-767213dc-2d92-4251-a36f-50afeaaf634f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:07.398144 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-767213dc-2d92-4251-a36f-50afeaaf634f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:07.399024 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-767213dc-2d92-4251-a36f-50afeaaf634f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:07.402869 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-767213dc-2d92-4251-a36f-50afeaaf634f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:07.464102 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-767213dc-2d92-4251-a36f-50afeaaf634f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.085779 Jan 10 12:55:07.483394 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 556/1089] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:55:07 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:07.691020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bca31a36-0bce-44e2-9e0d-c56b342847b8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:07.692139 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bca31a36-0bce-44e2-9e0d-c56b342847b8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:07.698856 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bca31a36-0bce-44e2-9e0d-c56b342847b8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:07.699308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bca31a36-0bce-44e2-9e0d-c56b342847b8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:07.700191 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bca31a36-0bce-44e2-9e0d-c56b342847b8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:07.700929 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bca31a36-0bce-44e2-9e0d-c56b342847b8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:07.740617 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bca31a36-0bce-44e2-9e0d-c56b342847b8 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/26a30fad-8e7d-427e-8338-18ee9f162356" status: 200 len: 194 microversion: 2.1 time: 0.055326 Jan 10 12:55:07.741799 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 534/1090] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jan 10 12:55:07 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/26a30fad-8e7d-427e-8338-18ee9f162356 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:07.751261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:07.751713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:07.759700 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:07.760906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:07.762275 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:07.764587 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:07.871181 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lazy-loading 'services' on Instance uuid aaa1635d-336e-4ff1-b152-bfa017da324b {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:55:07.951372 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-9fa87c2f-7d7f-4cf4-9fc4-75feded7b2d3 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/26a30fad-8e7d-427e-8338-18ee9f162356" status: 202 len: 0 microversion: 2.1 time: 0.203967 Jan 10 12:55:07.952578 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 557/1091] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:55:07 2022] DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/26a30fad-8e7d-427e-8338-18ee9f162356 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:55:09.087467 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-52ad7a1c-a49a-4be4-b909-84bef1703f21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:09.088601 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-52ad7a1c-a49a-4be4-b909-84bef1703f21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:09.096100 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52ad7a1c-a49a-4be4-b909-84bef1703f21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:09.096762 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52ad7a1c-a49a-4be4-b909-84bef1703f21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:09.097742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52ad7a1c-a49a-4be4-b909-84bef1703f21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:09.098360 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-52ad7a1c-a49a-4be4-b909-84bef1703f21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:09.133151 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-52ad7a1c-a49a-4be4-b909-84bef1703f21 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/11b4a1bf-d032-4513-b5a9-8b8cc4fdd4ce" status: 200 len: 194 microversion: 2.1 time: 0.049965 Jan 10 12:55:09.133911 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 535/1092] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jan 10 12:55:09 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/11b4a1bf-d032-4513-b5a9-8b8cc4fdd4ce => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:09.147103 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:09.147794 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:09.154152 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:09.154774 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:09.155911 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:09.156514 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:09.263366 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lazy-loading 'services' on Instance uuid aaa1635d-336e-4ff1-b152-bfa017da324b {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:55:09.346983 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-795e85d5-4782-4c96-b28c-153373ae8dc5 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/11b4a1bf-d032-4513-b5a9-8b8cc4fdd4ce" status: 202 len: 0 microversion: 2.1 time: 0.205492 Jan 10 12:55:09.348025 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 558/1093] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jan 10 12:55:09 2022] DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments/11b4a1bf-d032-4513-b5a9-8b8cc4fdd4ce => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:55:10.595859 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-206e1e4a-83a3-415d-8941-c099051cdc7f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:10.596958 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-206e1e4a-83a3-415d-8941-c099051cdc7f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:10.606867 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-206e1e4a-83a3-415d-8941-c099051cdc7f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:10.607643 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-206e1e4a-83a3-415d-8941-c099051cdc7f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:10.611805 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-206e1e4a-83a3-415d-8941-c099051cdc7f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:10.612891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-206e1e4a-83a3-415d-8941-c099051cdc7f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:10.677971 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-206e1e4a-83a3-415d-8941-c099051cdc7f tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095264 Jan 10 12:55:10.678915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 536/1094] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:55:10 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:55:10.885890 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7ac23712-24f8-47cf-8a50-c0ab1c419105 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:10.889785 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7ac23712-24f8-47cf-8a50-c0ab1c419105 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:10.916071 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7ac23712-24f8-47cf-8a50-c0ab1c419105 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:10.916781 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7ac23712-24f8-47cf-8a50-c0ab1c419105 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:10.917854 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7ac23712-24f8-47cf-8a50-c0ab1c419105 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:10.918605 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7ac23712-24f8-47cf-8a50-c0ab1c419105 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:10.962861 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7ac23712-24f8-47cf-8a50-c0ab1c419105 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081649 Jan 10 12:55:10.963915 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 559/1095] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jan 10 12:55:10 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 12:55:11.063937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:11.064323 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:11.071494 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:11.072135 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:11.073954 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:11.075449 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:11.113790 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:55:11.260068 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-fddd59e7-b547-4ce1-bde0-6622fd075be9 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 204 len: 0 microversion: 2.1 time: 0.200731 Jan 10 12:55:11.261101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 537/1096] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:55:11 2022] DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:55:11.274286 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:11.275142 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:11.283639 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:11.284094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:11.285058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:11.285693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:11.438796 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:11.446499 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c5929fe2-7989-4439-a9c4-742a703e1f15 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1672 microversion: 2.1 time: 0.180764 Jan 10 12:55:11.447185 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 560/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:11 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:55:12.464698 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:12.465519 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:12.473678 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:12.474321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:12.475417 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:12.475887 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:12.627737 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:12.635262 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-37387edd-b3db-4207-8441-b1c128ae6389 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1672 microversion: 2.1 time: 0.175046 Jan 10 12:55:12.635937 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 538/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:12 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:13.652626 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:13.653324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:13.661511 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:13.662015 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:13.662949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:13.663390 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:13.822351 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:13.831022 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-20b30f8e-2f12-499a-b406-a9dc3305db3a tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1672 microversion: 2.1 time: 0.182173 Jan 10 12:55:13.835573 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 561/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:13 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:14.848217 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:14.848951 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:14.856123 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:14.856676 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:14.857550 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:14.858064 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:15.012150 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:15.021498 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bc287f58-f42f-426f-b171-ecd93a784e83 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1672 microversion: 2.1 time: 0.176952 Jan 10 12:55:15.022061 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 539/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:14 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:16.039806 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:16.041834 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:16.063215 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:16.063942 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:16.065734 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:16.066706 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:16.365808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bbc10f093cd4a3f9de4d874cfa8b831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f048bd448f467aa0b37935d03a60e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:16.374490 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-da271fc7-286e-4a12-b39c-3ac75543b7e2 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 200 len: 1672 microversion: 2.1 time: 0.338501 Jan 10 12:55:16.385020 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 562/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:16 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 1672 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:16.581201 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-38d1760c-ab83-4ee4-9501-127a2929c4aa req-973e4ff4-e720-4e37-b3d7-5e7a63a2232f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa1635d-336e-4ff1-b152-bfa017da324b", "name": "network-vif-deleted", "tag": "ae828662-bdad-421c-96d6-5bded1ca3706"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:16.583012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:55:16.583012 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:55:16.593193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-38d1760c-ab83-4ee4-9501-127a2929c4aa req-973e4ff4-e720-4e37-b3d7-5e7a63a2232f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:16.593773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-38d1760c-ab83-4ee4-9501-127a2929c4aa req-973e4ff4-e720-4e37-b3d7-5e7a63a2232f service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:16.621552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-38d1760c-ab83-4ee4-9501-127a2929c4aa req-973e4ff4-e720-4e37-b3d7-5e7a63a2232f service nova] Creating event network-vif-deleted:ae828662-bdad-421c-96d6-5bded1ca3706 for instance aaa1635d-336e-4ff1-b152-bfa017da324b on hv-cinder-maste Jan 10 12:55:16.632397 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-38d1760c-ab83-4ee4-9501-127a2929c4aa req-973e4ff4-e720-4e37-b3d7-5e7a63a2232f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054892 Jan 10 12:55:16.633834 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 540/1102] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:55:17.392106 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:17.392981 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:17.401576 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:17.402029 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:17.403682 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:17.404326 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:17.421241 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] HTTP exception thrown: Instance aaa1635d-336e-4ff1-b152-bfa017da324b could not be found. Jan 10 12:55:17.421847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Returning 404 to user: Instance aaa1635d-336e-4ff1-b152-bfa017da324b could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:55:17.422699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-907fbeab-95cc-4b43-9e56-4f161e91d033 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 404 len: 111 microversion: 2.1 time: 0.034876 Jan 10 12:55:17.423260 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 563/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:17 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:17.433175 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-507d34b2-351c-4022-a8ca-008d075d8522 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '.version_select at 0x7f7fca783310>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:17.457532 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-507d34b2-351c-4022-a8ca-008d075d8522 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419061961" status: 202 len: 0 microversion: 2.1 time: 0.029120 Jan 10 12:55:17.458127 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 541/1104] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jan 10 12:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419061961 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:55:20.726565 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:20.727120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:20.772261 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:20.772732 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:20.773559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:20.774006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:20.823856 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] HTTP exception thrown: Instance aaa1635d-336e-4ff1-b152-bfa017da324b could not be found. Jan 10 12:55:20.824478 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Returning 404 to user: Instance aaa1635d-336e-4ff1-b152-bfa017da324b could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:55:20.825386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-67305fab-59ae-480c-b64c-9408876f2e3c tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 404 len: 111 microversion: 2.1 time: 0.106042 Jan 10 12:55:20.834821 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:20.835595 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: aaa1635d-336e-4ff1-b152-bfa017da324b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:20.838416 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 564/1105] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:55:20 2022] DELETE /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:20.842471 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:20.849567 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:20.859863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:20.860523 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:20.900336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] HTTP exception thrown: Instance aaa1635d-336e-4ff1-b152-bfa017da324b could not be found. Jan 10 12:55:20.901209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Returning 404 to user: Instance aaa1635d-336e-4ff1-b152-bfa017da324b could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:55:20.902534 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e4c43781-c7da-4bff-a586-141664bf62ea tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b" status: 404 len: 111 microversion: 2.1 time: 0.072265 Jan 10 12:55:20.905097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 542/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:20 2022] GET /compute/v2.1/servers/aaa1635d-336e-4ff1-b152-bfa017da324b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:22.127721 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:22.128259 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:22.138886 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:22.139342 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:22.140179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:22.140609 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:22.175552 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] HTTP exception thrown: Instance d04a2f28-f535-468a-ba8b-39cdc590147b could not be found. Jan 10 12:55:22.176113 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Returning 404 to user: Instance d04a2f28-f535-468a-ba8b-39cdc590147b could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:55:22.177219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-98ea24fe-4286-4c57-9a53-bcf25bc876c6 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 404 len: 111 microversion: 2.1 time: 0.053394 Jan 10 12:55:22.178912 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 565/1107] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:55:22 2022] DELETE /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:22.186921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:22.188146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] [instance: d04a2f28-f535-468a-ba8b-39cdc590147b] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:22.195065 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:22.195436 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:22.196275 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:22.196772 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:22.220071 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] HTTP exception thrown: Instance d04a2f28-f535-468a-ba8b-39cdc590147b could not be found. Jan 10 12:55:22.220679 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] Returning 404 to user: Instance d04a2f28-f535-468a-ba8b-39cdc590147b could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:55:22.221554 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9f858196-680f-4479-82a4-1beb40886925 tempest-AttachVolumeTestJSON-2108413537 tempest-AttachVolumeTestJSON-2108413537-project] 10.222.0.13 "GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b" status: 404 len: 111 microversion: 2.1 time: 0.038370 Jan 10 12:55:22.222112 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 543/1108] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:22 2022] GET /compute/v2.1/servers/d04a2f28-f535-468a-ba8b-39cdc590147b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:25.004726 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Action: 'create', calling method: .version_select at 0x7f7fca5954c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1716586870"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:25.026396 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Getting quotas for project 6274f5b54d23499882aaa38eced195e6. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:55:25.032230 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Getting quotas for user a59a1dbec22e452081ff7c6e6242cadc and project 6274f5b54d23499882aaa38eced195e6. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:55:25.058697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [bfb98b20-e1ed-43c0-8325-6deb3062ddc2] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 10 12:55:26.068089 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [bfb98b20-e1ed-43c0-8325-6deb3062ddc2] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41348. Jan 10 12:55:26.439758 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Getting quotas for project 6274f5b54d23499882aaa38eced195e6. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:55:26.444105 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Getting quotas for user a59a1dbec22e452081ff7c6e6242cadc and project 6274f5b54d23499882aaa38eced195e6. Resources: {'key_pairs'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:55:26.459210 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bc24dac0-5f5a-4397-8c84-56790454e0f3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.697710 Jan 10 12:55:26.479238 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 566/1109] 10.222.0.13 () {60 vars in 1157 bytes} [Mon Jan 10 12:55:24 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:28.529549 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9ca27cf2-05da-4627-bf5d-ccc75dc10911 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Action: 'create', calling method: .version_select at 0x7f7fca5da790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1562900466", "metadata": {"Type": "work"}}} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:28.974631 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9ca27cf2-05da-4627-bf5d-ccc75dc10911 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.561940 Jan 10 12:55:28.975395 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 544/1110] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jan 10 12:55:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 563 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 10 12:55:28.987878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d211f995-8ba9-4097-b340-d283ef5981e8 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca5fe940>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:29.068699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d211f995-8ba9-4097-b340-d283ef5981e8 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 200 len: 353 microversion: 2.1 time: 0.085290 Jan 10 12:55:29.070905 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 567/1111] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:55:28 2022] GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:30.086837 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d55d3a2a-4fa2-4006-93d7-ebb226df185d tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca71aaf0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:30.134057 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d55d3a2a-4fa2-4006-93d7-ebb226df185d tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 200 len: 354 microversion: 2.1 time: 0.053794 Jan 10 12:55:30.136468 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 545/1112] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:55:30 2022] GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:30.154179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-14d6cb05-0471-4f4a-89fc-10d605c87b61 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca73b9d0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:30.207989 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-14d6cb05-0471-4f4a-89fc-10d605c87b61 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 200 len: 354 microversion: 2.1 time: 0.059875 Jan 10 12:55:30.208616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 568/1113] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:55:30 2022] GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:30.226367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-be0ede2b-efe9-4387-bc79-9c2d7b203367 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca636940>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:30.290271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-be0ede2b-efe9-4387-bc79-9c2d7b203367 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 202 len: 0 microversion: 2.1 time: 0.067598 Jan 10 12:55:30.290840 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 546/1114] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jan 10 12:55:30 2022] DELETE /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:55:30.300931 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e58840bb-dc91-4f12-95f5-fd8288ab9fe0 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca7d91f0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:30.353119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e58840bb-dc91-4f12-95f5-fd8288ab9fe0 tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 200 len: 353 microversion: 2.1 time: 0.056031 Jan 10 12:55:30.353693 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 569/1115] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:55:30 2022] GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:31.368187 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-605529a3-e0b4-4a66-b657-bdcc8d0cd56e tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca7364c0>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:31.417965 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-605529a3-e0b4-4a66-b657-bdcc8d0cd56e tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 200 len: 353 microversion: 2.1 time: 0.053875 Jan 10 12:55:31.418530 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 547/1116] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:55:31 2022] GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:32.434222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-2fa47812-28b2-4f03-8fbf-8174ef0fe59d tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca73b5e0>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:32.485910 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-2fa47812-28b2-4f03-8fbf-8174ef0fe59d tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 200 len: 353 microversion: 2.1 time: 0.058138 Jan 10 12:55:32.486517 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 570/1117] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:55:32 2022] GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:33.499171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-109f5847-4dc1-46b0-b823-4d9715b085cb tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Calling method '.version_select at 0x7f7fca5e8160>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:33.525511 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-109f5847-4dc1-46b0-b823-4d9715b085cb tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] HTTP exception thrown: Volume c5d5c095-09d9-4066-a0cb-aa7afbb642e4 could not be found. Jan 10 12:55:33.526097 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-109f5847-4dc1-46b0-b823-4d9715b085cb tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] Returning 404 to user: Volume c5d5c095-09d9-4066-a0cb-aa7afbb642e4 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:55:33.526941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-109f5847-4dc1-46b0-b823-4d9715b085cb tempest-VolumesGetTestJSON-808172980 tempest-VolumesGetTestJSON-808172980-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4" status: 404 len: 109 microversion: 2.1 time: 0.032549 Jan 10 12:55:33.527460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 548/1118] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jan 10 12:55:33 2022] GET /compute/v2.1/os-volumes/c5d5c095-09d9-4066-a0cb-aa7afbb642e4 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:46.999477 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1598861311", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-174268589", "security_groups": [{"name": "tempest-secgroup-smoke-849435366"}], "block_device_mapping_v2": [{"uuid": "1a6f955d-79f5-4de8-819f-82c4c55395d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c5b8c8b5-d1c3-4f27-9dc6-e0e5ca957245"}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:47.110322 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] validate_networks() for [('c5b8c8b5-d1c3-4f27-9dc6-e0e5ca957245', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:55:47.498922 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:55:47.499344 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:55:47.499843 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:55:47.500282 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:55:47.500684 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:55:47.512324 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:47.512769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:47.513579 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:47.514011 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:47.530376 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:55:47.534738 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Getting quotas for user ffd65d5f1d484d48a3ed84cf1592956c and project 503dbd8843034c38a1dbc86c07c6f549. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:55:47.598375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:55:47.600666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a6f955d-79f5-4de8-819f-82c4c55395d2',volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:55:47.730848 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-30d3ca35-45b4-4224-91b5-2e907c7c4a42 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.735684 Jan 10 12:55:47.732162 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 571/1119] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:55:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:55:47.742445 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6ad36cfe-835d-46c0-85a9-219bf407b432 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:47.743187 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6ad36cfe-835d-46c0-85a9-219bf407b432 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:47.812046 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6ad36cfe-835d-46c0-85a9-219bf407b432 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:47.819865 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6ad36cfe-835d-46c0-85a9-219bf407b432 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1094 microversion: 2.1 time: 0.081753 Jan 10 12:55:47.820476 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 549/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:47 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:48.839079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:48.839697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:48.846375 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:48.846819 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:48.847628 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:48.848064 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:48.910445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:48.918452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-26ce201b-5c21-4bf9-b6a1-cc2d07200c5f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1192 microversion: 2.1 time: 0.084247 Jan 10 12:55:48.919131 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 572/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:48 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:49.938977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:49.939659 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:49.955227 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:49.955748 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:49.956902 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:49.957334 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:50.127571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:50.137595 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-06037c4a-ca29-421a-9453-289338e740b3 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.203974 Jan 10 12:55:50.139441 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 550/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:49 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:50.915128 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-636126647", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1716586870", "security_groups": [{"name": "tempest-secgroup-smoke-61546539"}], "networks": [{"uuid": "5dde8660-5815-4008-9294-7b6a2f37fa4c"}], "block_device_mapping_v2": [{"uuid": "7462bdfe-e722-4182-a70b-e5d5cc5b761b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:51.061252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-503f6362-e4ef-4402-bafa-2a2881d01f09 req-efc43fc4-5569-46a3-8d29-8236203a3f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cedaea1-ffa3-4eea-8f99-97b57791906e", "tag": "83a292d4-c9a0-44eb-9c5c-4824841c7475"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:51.063025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:55:51.063025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:55:51.067004 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] validate_networks() for [('5dde8660-5815-4008-9294-7b6a2f37fa4c', None, None, None, None, None)] {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:55:51.077292 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-503f6362-e4ef-4402-bafa-2a2881d01f09 req-efc43fc4-5569-46a3-8d29-8236203a3f8a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:51.077793 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-503f6362-e4ef-4402-bafa-2a2881d01f09 req-efc43fc4-5569-46a3-8d29-8236203a3f8a service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:51.108736 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-503f6362-e4ef-4402-bafa-2a2881d01f09 req-efc43fc4-5569-46a3-8d29-8236203a3f8a service nova] Creating event network-changed:83a292d4-c9a0-44eb-9c5c-4824841c7475 for instance 0cedaea1-ffa3-4eea-8f99-97b57791906e on hv-cinder-maste Jan 10 12:55:51.116706 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-503f6362-e4ef-4402-bafa-2a2881d01f09 req-efc43fc4-5569-46a3-8d29-8236203a3f8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059152 Jan 10 12:55:51.117836 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 551/1123] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:55:51.157829 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:51.158879 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:51.167639 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:51.169666 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:51.172635 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:51.173098 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:51.490069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:51.498000 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ad1b8e1a-282f-4683-a7f6-b943027afb0c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.345570 Jan 10 12:55:51.498775 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 552/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:51 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:51.662077 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:55:51.662441 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:55:51.662956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:55:51.663341 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:55:51.663769 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:55:51.674119 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:51.674575 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:51.675378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:51.675995 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:51.694828 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Getting quotas for project 6274f5b54d23499882aaa38eced195e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:55:51.698810 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Getting quotas for user a59a1dbec22e452081ff7c6e6242cadc and project 6274f5b54d23499882aaa38eced195e6. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:55:51.760344 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:55:51.763555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7462bdfe-e722-4182-a70b-e5d5cc5b761b',volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:55:51.954159 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-11bec279-b987-4b74-a01d-9e2c884a1be6 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.042794 Jan 10 12:55:51.962232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 573/1125] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:55:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:55:51.975029 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-2ab11f2a-ce0d-4d67-8a0b-41203572a156 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:51.976162 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-2ab11f2a-ce0d-4d67-8a0b-41203572a156 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:52.045674 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-2ab11f2a-ce0d-4d67-8a0b-41203572a156 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:52.053704 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-2ab11f2a-ce0d-4d67-8a0b-41203572a156 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1088 microversion: 2.1 time: 0.091865 Jan 10 12:55:52.060676 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 553/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:51 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1088 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:55:52.515664 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:52.516415 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:52.523654 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:52.524195 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:52.525633 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:52.526071 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:52.694044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:52.703229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-22a6130d-99f5-4619-9c23-22ff992b9f1c tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.191401 Jan 10 12:55:52.703842 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 574/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:52 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:53.072035 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:53.073294 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:53.080801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:53.081699 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:53.082719 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:53.083352 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:53.165809 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:53.176812 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c42472cc-dc78-4d5c-b716-af42bc56608c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1204 microversion: 2.1 time: 0.108355 Jan 10 12:55:53.178026 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 554/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:53 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:53.720630 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:53.721429 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:53.728175 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:53.729033 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:53.729825 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:53.730259 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:53.941844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:53.966386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e198499d-d8d8-47a2-a4a0-617c85e31d4f tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.236077 Jan 10 12:55:53.971648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 575/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:53 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:55:54.195017 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:54.195668 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:54.202782 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:54.203224 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:54.204053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:54.204481 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:54.406674 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:54.417139 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e31c426b-21f2-4414-bd6f-433be539ebf8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.224046 Jan 10 12:55:54.417910 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 555/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:54 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:54.952779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-0375a769-cd9e-45d4-83e8-1e703751fd29 req-70956d3b-5759-4bdb-880c-7735f7ca544b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca61f694-b312-4aef-918b-87a6983887f5", "tag": "8b1a545a-d619-434d-9274-e46c6b717505"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:55:54.954434 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:55:54.954434 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:55:54.978182 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0375a769-cd9e-45d4-83e8-1e703751fd29 req-70956d3b-5759-4bdb-880c-7735f7ca544b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:54.978849 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0375a769-cd9e-45d4-83e8-1e703751fd29 req-70956d3b-5759-4bdb-880c-7735f7ca544b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:54.983661 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:54.984616 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:54.993681 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:54.994971 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-0375a769-cd9e-45d4-83e8-1e703751fd29 req-70956d3b-5759-4bdb-880c-7735f7ca544b service nova] Creating event network-changed:8b1a545a-d619-434d-9274-e46c6b717505 for instance ca61f694-b312-4aef-918b-87a6983887f5 on hv-cinder-maste Jan 10 12:55:54.995315 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:54.996451 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:54.997095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:55.003989 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-0375a769-cd9e-45d4-83e8-1e703751fd29 req-70956d3b-5759-4bdb-880c-7735f7ca544b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054999 Jan 10 12:55:55.007949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 576/1131] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:55:55.164347 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:55.173535 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-caa49c2d-6720-4683-b73c-d30ccf74d2cd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.194369 Jan 10 12:55:55.181700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 556/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:54 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:55:55.435497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:55.436226 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:55.442656 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:55.443101 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:55.443924 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:55.444358 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:55.605174 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:55.612917 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8648b677-77fc-4d54-8bf5-a0c94b8d1905 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.182113 Jan 10 12:55:55.613445 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 577/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:55 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:56.196801 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:56.198078 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:56.204565 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:56.205128 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:56.205952 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:56.206390 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:56.420550 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:56.428236 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-83605888-1d2e-4a23-b6ff-deb59e08a1c6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.237805 Jan 10 12:55:56.429060 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 557/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:56 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:56.630273 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:56.631129 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:56.637916 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:56.638340 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:56.639538 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:56.640100 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:56.787987 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:56.796786 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-755f7945-44b6-4aca-91b4-38f4697a9337 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.170374 Jan 10 12:55:56.797342 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 578/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:56 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:57.446609 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:57.447242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:57.453114 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:57.453577 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:57.454365 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:57.454821 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:57.593064 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:57.600839 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-66bf9f16-82ef-488d-882e-b8b1d5517086 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.158358 Jan 10 12:55:57.601421 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 558/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:57 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:57.813378 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:57.814097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:57.820740 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:57.821226 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:57.822199 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:57.822648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:57.973263 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:57.981980 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-49035fd3-1dd2-4e51-835e-0433b274ee1c tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.172286 Jan 10 12:55:57.982632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 579/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:57 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:58.620100 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:58.620717 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:58.627119 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:58.627606 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:58.628395 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:58.628835 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:58.778697 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:58.785995 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-086679db-dbdc-4398-9aa8-a8b2e7c949be tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.169852 Jan 10 12:55:58.793771 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 559/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:58 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:58.998852 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:58.999476 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:59.009646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:59.010402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:59.011392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:59.012059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:59.177387 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:59.186559 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-607d543e-2073-4107-acc6-53c3c0146681 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.192089 Jan 10 12:55:59.196030 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 580/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:58 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:55:59.814667 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:55:59.815733 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:55:59.824881 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:59.825336 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:59.826126 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:55:59.826569 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:55:59.965605 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:55:59.977189 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-659ac2d4-90dd-44a2-8c89-775f0ea0649a tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.168566 Jan 10 12:55:59.977924 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 560/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:55:59 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:00.144225 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2092412167", "imageRef": "ef1165de-9c81-4a05-b582-9efe0454a6e4", "flavorRef": "452"}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:00.197880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.network.neutron [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] validate_networks() for None {{(pid=123137) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 12:56:00.203184 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:00.203904 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:00.210079 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:00.210524 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:00.211297 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:00.211759 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:00.513882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:00.521576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e641ea11-21f9-42b0-8edd-f8665d016af8 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.322070 Jan 10 12:56:00.522158 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 561/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:00 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:00.530786 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Flavor limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 12:56:00.531212 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Image limits 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 12:56:00.531710 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Flavor pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 12:56:00.532127 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Image pref 0:0:0 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 12:56:00.532547 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.virt.hardware [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 12:56:00.542543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:00.542986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:00.543846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:00.544313 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:00.561497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Getting quotas for project 0dc4284bad574579a432ee33d1686603. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 12:56:00.565878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.quota [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Getting quotas for user 14124f9a628049dab79cfc323bece94c and project 0dc4284bad574579a432ee33d1686603. Resources: {'ram', 'instances', 'cores'} {{(pid=123137) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 12:56:00.577625 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Going to run 1 instances... {{(pid=123137) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 12:56:00.580083 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1165de-9c81-4a05-b582-9efe0454a6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 12:56:00.623650 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-d8d19abf-25b7-4663-a0b9-a71f65f489b9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483094 Jan 10 12:56:00.624460 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 581/1142] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jan 10 12:56:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 12:56:00.634233 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9309e01f-e7ad-4e91-b619-cf56fd6a4ca1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:00.635489 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9309e01f-e7ad-4e91-b619-cf56fd6a4ca1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:00.690444 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-9309e01f-e7ad-4e91-b619-cf56fd6a4ca1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:00.697143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9309e01f-e7ad-4e91-b619-cf56fd6a4ca1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1215 microversion: 2.1 time: 0.066497 Jan 10 12:56:00.698270 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 562/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:00 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:00.998810 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:00.999390 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:01.005659 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:01.006156 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:01.006969 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:01.007421 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:01.065687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-88431109-7b07-4bc3-a470-b19a09511aa3 req-8a8a9934-e817-4112-af72-2cb8e7177e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedaea1-ffa3-4eea-8f99-97b57791906e", "name": "network-vif-plugged", "status": "completed", "tag": "83a292d4-c9a0-44eb-9c5c-4824841c7475"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:01.068054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:56:01.068054 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:56:01.077543 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-88431109-7b07-4bc3-a470-b19a09511aa3 req-8a8a9934-e817-4112-af72-2cb8e7177e10 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:01.078967 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-88431109-7b07-4bc3-a470-b19a09511aa3 req-8a8a9934-e817-4112-af72-2cb8e7177e10 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:01.094033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-88431109-7b07-4bc3-a470-b19a09511aa3 req-8a8a9934-e817-4112-af72-2cb8e7177e10 service nova] Creating event network-vif-plugged:83a292d4-c9a0-44eb-9c5c-4824841c7475 for instance 0cedaea1-ffa3-4eea-8f99-97b57791906e on hv-cinder-maste Jan 10 12:56:01.100448 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-88431109-7b07-4bc3-a470-b19a09511aa3 req-8a8a9934-e817-4112-af72-2cb8e7177e10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038004 Jan 10 12:56:01.101051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 563/1144] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:56:01.157278 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:01.165523 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-4a10804b-9738-4652-8909-8bc37ee737c1 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.170795 Jan 10 12:56:01.166986 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 582/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:00 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:01.541400 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:01.542657 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:01.559463 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:01.561576 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:01.564705 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:01.565454 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:01.716313 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:01.717219 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:01.726594 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:01.727433 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:01.729126 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:01.729812 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:01.736146 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:01.746209 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8c3ef57a-27b5-493a-83d1-2f255f2a9f76 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.211058 Jan 10 12:56:01.746910 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 564/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:01 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:01.829793 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:01.837141 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-05cabce5-dbd9-440e-8fc8-c977c8725be7 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1273 microversion: 2.1 time: 0.125316 Jan 10 12:56:01.838202 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 583/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:01 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:02.184205 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:02.184787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:02.191328 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:02.191785 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:02.192570 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:02.193002 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:02.326525 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:02.334955 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-cf7643bd-fe1f-49d0-a443-4a3d71eb43d4 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1265 microversion: 2.1 time: 0.155473 Jan 10 12:56:02.344389 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 565/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:02 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:02.771784 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:02.773610 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:02.781494 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:02.782069 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:02.782957 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:02.784009 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:02.856644 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:02.857552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:02.864247 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:02.864986 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:02.866074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:02.866679 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:03.040050 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:03.057586 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bcdcd64d-698a-43a5-a61e-6504cf104ff4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.297304 Jan 10 12:56:03.058767 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 584/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:02 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:03.125198 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:03.133339 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-159f2d09-b2f2-44e2-a6e4-0ebc580e2728 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1315 microversion: 2.1 time: 0.281960 Jan 10 12:56:03.134675 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 566/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:02 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:03.351491 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:03.352471 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:03.359792 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:03.360523 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:03.361556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:03.362213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:03.515615 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:03.522949 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-038e41ac-fcc4-4513-b66b-7149a3ac0e67 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1452 microversion: 2.1 time: 0.175170 Jan 10 12:56:03.523531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 585/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:03 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:03.539143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:03.539786 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:03.548354 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-12606cee-1192-4560-9203-914130834b3c req-2cab1cb7-dbbc-4431-9f98-c26d56c32897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f", "tag": "13f35324-7786-4d43-a2c6-43396a475bb2"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:03.549563 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:03.555666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:56:03.555666 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:56:03.557053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:03.557053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:03.557053 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:03.558055 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-12606cee-1192-4560-9203-914130834b3c req-2cab1cb7-dbbc-4431-9f98-c26d56c32897 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:03.558404 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-12606cee-1192-4560-9203-914130834b3c req-2cab1cb7-dbbc-4431-9f98-c26d56c32897 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:03.582490 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-12606cee-1192-4560-9203-914130834b3c req-2cab1cb7-dbbc-4431-9f98-c26d56c32897 service nova] Creating event network-changed:13f35324-7786-4d43-a2c6-43396a475bb2 for instance c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f on hv-cinder-maste Jan 10 12:56:03.587851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-12606cee-1192-4560-9203-914130834b3c req-2cab1cb7-dbbc-4431-9f98-c26d56c32897 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044378 Jan 10 12:56:03.589906 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 586/1152] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:56:03.733317 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:03.745946 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bc239384-95ec-44ef-b4fb-737d8a6b4c11 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1452 microversion: 2.1 time: 0.210631 Jan 10 12:56:03.746543 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 567/1153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:03 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:04.077017 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:04.077743 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:04.085185 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:04.085695 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:04.086655 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:04.087086 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:04.150074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:04.151148 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:04.157716 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:04.158415 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:04.159246 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:04.159913 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:04.611989 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:04.621185 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:04.624649 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-bfc74e55-3378-4ee3-976a-d05ca8e65683 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.553559 Jan 10 12:56:04.634167 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 587/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:04 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:04.641934 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-a3992f90-1154-4715-ad13-f503915ae76c tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1315 microversion: 2.1 time: 0.495550 Jan 10 12:56:04.651531 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 568/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:04 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:56:05.071340 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-95ff5681-be41-4b68-a9a1-a29a12308650 req-d67ffdc6-f6e5-42e6-99c7-3ddba36c656c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca61f694-b312-4aef-918b-87a6983887f5", "name": "network-vif-plugged", "status": "completed", "tag": "8b1a545a-d619-434d-9274-e46c6b717505"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:05.073144 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:56:05.073144 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:56:05.081419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-95ff5681-be41-4b68-a9a1-a29a12308650 req-d67ffdc6-f6e5-42e6-99c7-3ddba36c656c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:05.082604 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-95ff5681-be41-4b68-a9a1-a29a12308650 req-d67ffdc6-f6e5-42e6-99c7-3ddba36c656c service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:05.095654 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-95ff5681-be41-4b68-a9a1-a29a12308650 req-d67ffdc6-f6e5-42e6-99c7-3ddba36c656c service nova] Creating event network-vif-plugged:8b1a545a-d619-434d-9274-e46c6b717505 for instance ca61f694-b312-4aef-918b-87a6983887f5 on hv-cinder-maste Jan 10 12:56:05.103972 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-95ff5681-be41-4b68-a9a1-a29a12308650 req-d67ffdc6-f6e5-42e6-99c7-3ddba36c656c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034341 Jan 10 12:56:05.104614 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 588/1156] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:56:05.640288 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:05.640941 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:05.646890 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:05.647367 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:05.648170 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:05.648607 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:05.659350 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:05.660844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:05.667748 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:05.668511 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:05.669525 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:05.670176 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:05.903346 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:05.908171 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:05.911715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4a1bf4cb-c588-43be-b17e-ee77a4cac885 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1258 microversion: 2.1 time: 0.274885 Jan 10 12:56:05.919642 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 569/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:05 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1258 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:05.924246 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-526d346f-eb93-44c7-86fc-7debb9253cc1 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1315 microversion: 2.1 time: 0.269521 Jan 10 12:56:05.925035 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 589/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:05 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:06.068355 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-666e12f1-63da-4a41-b852-e8593795b1c3 req-54a8dafb-e16f-4348-b0eb-2daf81cb2c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cedaea1-ffa3-4eea-8f99-97b57791906e", "tag": "83a292d4-c9a0-44eb-9c5c-4824841c7475"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:06.070687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:56:06.070687 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:56:06.078159 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-666e12f1-63da-4a41-b852-e8593795b1c3 req-54a8dafb-e16f-4348-b0eb-2daf81cb2c82 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:06.078753 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-666e12f1-63da-4a41-b852-e8593795b1c3 req-54a8dafb-e16f-4348-b0eb-2daf81cb2c82 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:06.090888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-666e12f1-63da-4a41-b852-e8593795b1c3 req-54a8dafb-e16f-4348-b0eb-2daf81cb2c82 service nova] Creating event network-changed:83a292d4-c9a0-44eb-9c5c-4824841c7475 for instance 0cedaea1-ffa3-4eea-8f99-97b57791906e on hv-cinder-maste Jan 10 12:56:06.097089 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-666e12f1-63da-4a41-b852-e8593795b1c3 req-54a8dafb-e16f-4348-b0eb-2daf81cb2c82 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033218 Jan 10 12:56:06.097908 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 570/1159] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:56:06.930711 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:06.932671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:06.939553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:06.941415 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:06.942247 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:06.942683 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:06.943066 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:06.943883 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:06.951075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:06.951538 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:06.952332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:06.952769 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:07.166616 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:07.174618 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:07.185591 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-5f11f7c1-da75-4717-9305-7162da516b5f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1443 microversion: 2.1 time: 0.260212 Jan 10 12:56:07.189188 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-01e9130c-d77c-4508-bbf7-10b5be717e88 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1315 microversion: 2.1 time: 0.250541 Jan 10 12:56:07.189773 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 571/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:06 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:07.190223 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 590/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:06 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1443 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:07.206074 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:07.206708 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:07.212877 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:07.213912 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:07.214710 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:07.215140 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:07.352717 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:07.360332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-d77061cf-4a39-4ac1-a422-c5d641f310c4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1443 microversion: 2.1 time: 0.158061 Jan 10 12:56:07.360902 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 572/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:07 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:08.205754 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:08.206338 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:08.212596 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:08.213308 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:08.214107 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:08.214543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:08.463993 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:08.470836 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-ddf559c0-84a5-4deb-b5a6-e6e41e511ea0 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1315 microversion: 2.1 time: 0.268742 Jan 10 12:56:08.471419 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 591/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:08 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:56:09.085863 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [req-9611c940-05fe-4713-8bf8-b2b7ed6f8b4b req-053a1699-a134-4ac5-84e5-8528c09d359b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f", "name": "network-vif-plugged", "status": "completed", "tag": "13f35324-7786-4d43-a2c6-43396a475bb2"}]} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:09.087492 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:56:09.087492 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: warnings.warn(msg) Jan 10 12:56:09.095546 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-9611c940-05fe-4713-8bf8-b2b7ed6f8b4b req-053a1699-a134-4ac5-84e5-8528c09d359b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:09.095999 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [req-9611c940-05fe-4713-8bf8-b2b7ed6f8b4b req-053a1699-a134-4ac5-84e5-8528c09d359b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:09.108393 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.compute.server_external_events [req-9611c940-05fe-4713-8bf8-b2b7ed6f8b4b req-053a1699-a134-4ac5-84e5-8528c09d359b service nova] Creating event network-vif-plugged:13f35324-7786-4d43-a2c6-43396a475bb2 for instance c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f on hv-cinder-maste Jan 10 12:56:09.113398 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [req-9611c940-05fe-4713-8bf8-b2b7ed6f8b4b req-053a1699-a134-4ac5-84e5-8528c09d359b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031500 Jan 10 12:56:09.114066 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 573/1164] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:56:09.448425 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-85610b5e-0f28-4263-9bd1-de42dc9b7573 req-507d9cf7-7cbc-431a-9950-696a8c50de44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca61f694-b312-4aef-918b-87a6983887f5", "tag": "8b1a545a-d619-434d-9274-e46c6b717505"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:09.450027 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:56:09.450027 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:56:09.457396 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-85610b5e-0f28-4263-9bd1-de42dc9b7573 req-507d9cf7-7cbc-431a-9950-696a8c50de44 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:09.457848 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-85610b5e-0f28-4263-9bd1-de42dc9b7573 req-507d9cf7-7cbc-431a-9950-696a8c50de44 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:09.472643 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-85610b5e-0f28-4263-9bd1-de42dc9b7573 req-507d9cf7-7cbc-431a-9950-696a8c50de44 service nova] Creating event network-changed:8b1a545a-d619-434d-9274-e46c6b717505 for instance ca61f694-b312-4aef-918b-87a6983887f5 on hv-cinder-maste Jan 10 12:56:09.480913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-85610b5e-0f28-4263-9bd1-de42dc9b7573 req-507d9cf7-7cbc-431a-9950-696a8c50de44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036316 Jan 10 12:56:09.481757 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 592/1165] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:56:09.488853 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:09.489574 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:09.496085 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:09.496536 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:09.497321 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:09.497751 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:09.637117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:09.644450 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8dda3dc6-5ed1-4f14-af3b-0d97b3b931bd tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1315 microversion: 2.1 time: 0.159803 Jan 10 12:56:09.645014 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 574/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:09 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:10.662816 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:10.663548 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:10.671461 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:10.671925 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:10.672838 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:10.673348 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:10.814844 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:10.822952 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e07d7373-ca4b-4dea-88d5-b1fab50c17ec tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1464 microversion: 2.1 time: 0.164861 Jan 10 12:56:10.823543 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 593/1167] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:10 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:10.860020 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:10.860572 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:10.867182 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:10.867647 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:10.868731 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:10.869286 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:10.895062 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:56:10.984655 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-9c1a1cb6-d53f-495b-bd5b-9e9565e08992 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 204 len: 0 microversion: 2.1 time: 0.127957 Jan 10 12:56:10.985255 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 575/1168] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:56:10 2022] DELETE /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:56:10.993768 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:10.994423 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:11.000951 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:11.001406 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:11.002193 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:11.002632 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:11.150038 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:11.159454 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-dcac55b8-8ba4-40c9-a7f9-0fc2d83a7ba4 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1470 microversion: 2.1 time: 0.169788 Jan 10 12:56:11.160094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 594/1169] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:10 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:12.177859 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:12.178510 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:12.185841 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:12.186281 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:12.187057 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:12.187487 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:12.331755 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:12.339638 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-028471ad-b6e0-425a-9aed-8b86e28620c9 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1470 microversion: 2.1 time: 0.165953 Jan 10 12:56:12.340234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 576/1170] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:12 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:12.871384 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-0515205a-7a19-4584-aa26-43b7a6be492a req-f65deddd-bc31-4be7-ac47-aa7eba8a540b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f", "name": "network-vif-deleted", "tag": "13f35324-7786-4d43-a2c6-43396a475bb2"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:56:12.873762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:56:12.873762 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:56:12.882130 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0515205a-7a19-4584-aa26-43b7a6be492a req-f65deddd-bc31-4be7-ac47-aa7eba8a540b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:12.882539 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-0515205a-7a19-4584-aa26-43b7a6be492a req-f65deddd-bc31-4be7-ac47-aa7eba8a540b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:12.897280 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-0515205a-7a19-4584-aa26-43b7a6be492a req-f65deddd-bc31-4be7-ac47-aa7eba8a540b service nova] Creating event network-vif-deleted:13f35324-7786-4d43-a2c6-43396a475bb2 for instance c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f on hv-cinder-maste Jan 10 12:56:12.904532 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-0515205a-7a19-4584-aa26-43b7a6be492a req-f65deddd-bc31-4be7-ac47-aa7eba8a540b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036915 Jan 10 12:56:12.905391 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 595/1171] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:56:13.358237 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:13.359039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:13.366028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:13.366481 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:13.367496 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:13.368124 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:13.405360 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:13.405821 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:13.406279 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lazy-loading 'fault' on Instance uuid c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:56:13.451765 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14124f9a628049dab79cfc323bece94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc4284bad574579a432ee33d1686603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:56:13.458418 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-172d1a9b-d54f-4e49-acda-7d379ee4e780 tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 200 len: 1305 microversion: 2.1 time: 0.104931 Jan 10 12:56:13.458974 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 577/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:13 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:56:14.480880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:56:14.481437 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] [instance: c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:56:14.488343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:14.488808 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:14.489583 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:56:14.490003 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:56:14.503521 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] HTTP exception thrown: Instance c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f could not be found. Jan 10 12:56:14.504145 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] Returning 404 to user: Instance c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:56:14.504967 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f3772d51-9bc9-49fa-bde6-468e2366b98d tempest-VolumesNegativeTest-1688825575 tempest-VolumesNegativeTest-1688825575-project] 10.222.0.13 "GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f" status: 404 len: 111 microversion: 2.1 time: 0.030788 Jan 10 12:56:14.505498 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 596/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:56:14 2022] GET /compute/v2.1/servers/c5edcdf7-8dbb-4368-a6e0-56024bc6ee2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:57:46.371718 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:46.372259 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:46.374088 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-e042204f-bba4-40bc-8b8d-8ecc86e7eb11 req-ab1aebdd-8c82-4130-8843-f7404495c313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cedaea1-ffa3-4eea-8f99-97b57791906e", "tag": "83a292d4-c9a0-44eb-9c5c-4824841c7475"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:57:46.375880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:57:46.375880 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:57:46.378735 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:46.379456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:46.380001 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:46.380434 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:46.383968 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-e042204f-bba4-40bc-8b8d-8ecc86e7eb11 req-ab1aebdd-8c82-4130-8843-f7404495c313 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:46.384508 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-e042204f-bba4-40bc-8b8d-8ecc86e7eb11 req-ab1aebdd-8c82-4130-8843-f7404495c313 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:46.396036 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-e042204f-bba4-40bc-8b8d-8ecc86e7eb11 req-ab1aebdd-8c82-4130-8843-f7404495c313 service nova] Creating event network-changed:83a292d4-c9a0-44eb-9c5c-4824841c7475 for instance 0cedaea1-ffa3-4eea-8f99-97b57791906e on hv-cinder-maste Jan 10 12:57:46.402053 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-e042204f-bba4-40bc-8b8d-8ecc86e7eb11 req-ab1aebdd-8c82-4130-8843-f7404495c313 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032648 Jan 10 12:57:46.402923 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 597/1174] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:57:46.407361 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:57:46.495824 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b04577c8-00a4-4794-aabf-00ecf7f27319 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 204 len: 0 microversion: 2.1 time: 0.128266 Jan 10 12:57:46.497587 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 578/1175] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:57:46 2022] DELETE /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:57:46.505958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:46.507345 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:46.513654 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:46.514381 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:46.515359 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:46.516026 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:46.656651 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:57:46.665965 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-0e63ca8f-a3c0-4375-ab02-fec8c9ea0eda tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1577 microversion: 2.1 time: 0.164123 Jan 10 12:57:46.666742 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 598/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:46 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:57:47.685979 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:47.686725 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:47.693426 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:47.693872 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:47.694803 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:47.695715 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:48.028752 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:57:48.036436 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b5f94749-256d-4bfb-8dff-d0dc5343bcc9 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1458 microversion: 2.1 time: 0.354622 Jan 10 12:57:48.037408 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 579/1177] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:47 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1458 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:57:48.508945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-acfa1801-0a85-4ee6-98b2-ef94bb4321bd req-ad5b621f-cc10-4ee7-8e0c-f48f309eaa85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cedaea1-ffa3-4eea-8f99-97b57791906e", "name": "network-vif-deleted", "tag": "83a292d4-c9a0-44eb-9c5c-4824841c7475"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:57:48.510716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:57:48.510716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:57:48.518728 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-acfa1801-0a85-4ee6-98b2-ef94bb4321bd req-ad5b621f-cc10-4ee7-8e0c-f48f309eaa85 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:48.519087 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-acfa1801-0a85-4ee6-98b2-ef94bb4321bd req-ad5b621f-cc10-4ee7-8e0c-f48f309eaa85 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:48.530428 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-acfa1801-0a85-4ee6-98b2-ef94bb4321bd req-ad5b621f-cc10-4ee7-8e0c-f48f309eaa85 service nova] Creating event network-vif-deleted:83a292d4-c9a0-44eb-9c5c-4824841c7475 for instance 0cedaea1-ffa3-4eea-8f99-97b57791906e on hv-cinder-maste Jan 10 12:57:48.535640 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-acfa1801-0a85-4ee6-98b2-ef94bb4321bd req-ad5b621f-cc10-4ee7-8e0c-f48f309eaa85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030684 Jan 10 12:57:48.536267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 599/1178] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:57:49.056947 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:49.057670 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:49.065888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:49.066501 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:49.067627 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:49.068265 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:49.100897 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:49.101341 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:49.102308 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.objects.instance [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lazy-loading 'fault' on Instance uuid 0cedaea1-ffa3-4eea-8f99-97b57791906e {{(pid=123138) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:57:49.141586 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:57:49.149252 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-dd3929f0-b4cb-43f9-8fef-06827dd78a88 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 200 len: 1230 microversion: 2.1 time: 0.098053 Jan 10 12:57:49.149856 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 580/1179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:49 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:57:50.169932 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:50.171125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 0cedaea1-ffa3-4eea-8f99-97b57791906e] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:50.179018 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:50.179572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:50.180841 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:50.181343 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:50.195352 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] HTTP exception thrown: Instance 0cedaea1-ffa3-4eea-8f99-97b57791906e could not be found. Jan 10 12:57:50.195997 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Returning 404 to user: Instance 0cedaea1-ffa3-4eea-8f99-97b57791906e could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:57:50.196840 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-dd2c94f4-d615-450c-a259-02aa653c7c08 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e" status: 404 len: 111 microversion: 2.1 time: 0.033590 Jan 10 12:57:50.197386 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 600/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:50 2022] GET /compute/v2.1/servers/0cedaea1-ffa3-4eea-8f99-97b57791906e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:57:53.341147 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:53.341691 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:53.344380 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-4cc431f1-25a5-48db-91df-c3dbcb3fd402 req-a2fe76f6-a676-49f7-9c3a-c407c4f7225b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ec6184-c920-4234-a9f6-5e726a1be681", "tag": "b7bcefb3-698a-4790-bca2-57d443e10d43"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:57:53.346169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:57:53.346169 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:57:53.348428 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:53.348814 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:53.349604 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:53.350035 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:53.354423 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-4cc431f1-25a5-48db-91df-c3dbcb3fd402 req-a2fe76f6-a676-49f7-9c3a-c407c4f7225b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:53.354423 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-4cc431f1-25a5-48db-91df-c3dbcb3fd402 req-a2fe76f6-a676-49f7-9c3a-c407c4f7225b service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:53.365913 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-4cc431f1-25a5-48db-91df-c3dbcb3fd402 req-a2fe76f6-a676-49f7-9c3a-c407c4f7225b service nova] Creating event network-changed:b7bcefb3-698a-4790-bca2-57d443e10d43 for instance 17ec6184-c920-4234-a9f6-5e726a1be681 on hv-cinder-maste Jan 10 12:57:53.371908 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-4cc431f1-25a5-48db-91df-c3dbcb3fd402 req-a2fe76f6-a676-49f7-9c3a-c407c4f7225b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031025 Jan 10 12:57:53.372531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 601/1181] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:57:53.380196 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:57:53.465820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-5fd88833-0693-4f7d-a53b-f9ef64df29ca tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 204 len: 0 microversion: 2.1 time: 0.127921 Jan 10 12:57:53.466921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 581/1182] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:57:53 2022] DELETE /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:57:53.476349 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:53.477306 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:53.483996 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:53.484546 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:53.485809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:53.485809 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:53.624079 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:57:53.631961 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8f1e8b18-2e62-4913-8f70-a9817a5da586 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1573 microversion: 2.1 time: 0.160056 Jan 10 12:57:53.632851 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 602/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:53 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:57:54.650063 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:54.652062 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:54.659033 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:54.659484 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:54.660310 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:54.660747 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:54.801453 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:57:54.809814 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-6848d35c-fe3c-4c64-924c-cb7b9c99322d tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1456 microversion: 2.1 time: 0.163860 Jan 10 12:57:54.810398 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 582/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:54 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1456 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:57:55.692985 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-55afdb05-01f0-4925-9e16-4933362e78ac req-96488a3e-8fe0-4d4f-86c5-c41016bb0da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ec6184-c920-4234-a9f6-5e726a1be681", "name": "network-vif-deleted", "tag": "b7bcefb3-698a-4790-bca2-57d443e10d43"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:57:55.694497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:57:55.694497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:57:55.702659 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-55afdb05-01f0-4925-9e16-4933362e78ac req-96488a3e-8fe0-4d4f-86c5-c41016bb0da1 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:55.703095 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-55afdb05-01f0-4925-9e16-4933362e78ac req-96488a3e-8fe0-4d4f-86c5-c41016bb0da1 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:55.715399 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-55afdb05-01f0-4925-9e16-4933362e78ac req-96488a3e-8fe0-4d4f-86c5-c41016bb0da1 service nova] Creating event network-vif-deleted:b7bcefb3-698a-4790-bca2-57d443e10d43 for instance 17ec6184-c920-4234-a9f6-5e726a1be681 on hv-cinder-maste Jan 10 12:57:55.720238 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-55afdb05-01f0-4925-9e16-4933362e78ac req-96488a3e-8fe0-4d4f-86c5-c41016bb0da1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030909 Jan 10 12:57:55.720833 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 603/1185] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:57:55.829959 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:55.830819 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:55.841048 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:55.841806 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:55.843056 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:55.844039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:55.912779 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd65d5f1d484d48a3ed84cf1592956c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '503dbd8843034c38a1dbc86c07c6f549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:57:55.921184 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-c77cddb2-8c18-49e5-99d9-f043de78a6e6 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 200 len: 1223 microversion: 2.1 time: 0.097446 Jan 10 12:57:55.921764 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 583/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:55 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:57:56.943892 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:56.945066 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 17ec6184-c920-4234-a9f6-5e726a1be681] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:56.955859 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:56.956618 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:56.957918 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:56.958655 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:56.973959 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] HTTP exception thrown: Instance 17ec6184-c920-4234-a9f6-5e726a1be681 could not be found. Jan 10 12:57:56.974555 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Returning 404 to user: Instance 17ec6184-c920-4234-a9f6-5e726a1be681 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:57:56.975415 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-8e70c7a7-03b4-48db-bfa8-5d2595f68f47 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681" status: 404 len: 111 microversion: 2.1 time: 0.039191 Jan 10 12:57:56.975983 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 604/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:56 2022] GET /compute/v2.1/servers/17ec6184-c920-4234-a9f6-5e726a1be681 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:57:57.453287 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:57.453882 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:57.460016 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:57.460456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:57.461218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:57.461648 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:57.475263 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.wsgi [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] HTTP exception thrown: Instance 508c5420-5725-4665-b594-8990cf7bc668 could not be found. Jan 10 12:57:57.475888 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Returning 404 to user: Instance 508c5420-5725-4665-b594-8990cf7bc668 could not be found. {{(pid=123138) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:57:57.476699 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-10485946-75ed-42d1-9807-b37445d749e8 tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "DELETE /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 404 len: 111 microversion: 2.1 time: 0.027219 Jan 10 12:57:57.477220 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 584/1188] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:57:57 2022] DELETE /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:57:57.486121 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:57.486741 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] [instance: 508c5420-5725-4665-b594-8990cf7bc668] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:57:57.493502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:57.493956 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:57.494958 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:57:57.495427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:57:57.508638 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] HTTP exception thrown: Instance 508c5420-5725-4665-b594-8990cf7bc668 could not be found. Jan 10 12:57:57.509232 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Returning 404 to user: Instance 508c5420-5725-4665-b594-8990cf7bc668 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:57:57.510179 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-f325552d-16cf-4da7-b0c0-815bee0ad9dd tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668" status: 404 len: 111 microversion: 2.1 time: 0.027804 Jan 10 12:57:57.510708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 605/1189] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:57:57 2022] GET /compute/v2.1/servers/508c5420-5725-4665-b594-8990cf7bc668 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:57:58.812815 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-eaf56dd4-af17-4ddb-8e26-ba5c068664ac tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] Calling method '.version_select at 0x7f7fca747790>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:57:58.841156 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-eaf56dd4-af17-4ddb-8e26-ba5c068664ac tempest-TestVolumeBootPattern-1302288884 tempest-TestVolumeBootPattern-1302288884-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-174268589" status: 202 len: 0 microversion: 2.1 time: 0.032061 Jan 10 12:57:58.841740 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 585/1190] 10.222.0.13 () {58 vars in 1259 bytes} [Mon Jan 10 12:57:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-174268589 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:58:07.975308 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:58:07.976044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:07.983553 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:07.984000 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:07.984775 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:07.985203 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:08.008637 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.objects.instance [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lazy-loading 'flavor' on Instance uuid ca61f694-b312-4aef-918b-87a6983887f5 {{(pid=123137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 12:58:08.086779 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7f9355e8-55b6-48f3-81af-79244bfb610f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "POST /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5/action" status: 202 len: 0 microversion: 2.1 time: 0.115917 Jan 10 12:58:08.087373 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 606/1191] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:58:07 2022] POST /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 12:58:08.096460 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:08.097016 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:08.103921 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:08.104399 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:08.105171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:08.105639 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:08.245594 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:08.254231 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b947a1af-6c81-453c-be3c-8bed3d9e9a98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.162128 Jan 10 12:58:08.254822 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 586/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:08 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 12:58:09.276439 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:09.277655 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:09.288427 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:09.289173 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:09.290501 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:09.291222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:09.670817 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:09.679229 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-455832df-0e3a-41c3-bf00-8e454f5197bd tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.410360 Jan 10 12:58:09.680213 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 607/1193] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:09 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:10.702134 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:10.702787 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:10.709521 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:10.710011 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:10.710803 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:10.711242 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:10.852724 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:10.860728 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1ef26a77-d36f-4712-8b70-eebe44930c49 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.165267 Jan 10 12:58:10.861422 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 587/1194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:10 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:11.884521 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:11.885506 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:11.896059 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:11.896813 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:11.898127 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:11.898867 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:12.051450 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:12.061058 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-49c48c40-e00a-4e15-9dd9-c20ea406a0e9 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.182741 Jan 10 12:58:12.062125 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 608/1195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:11 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:13.085326 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:13.086182 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:13.097100 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:13.097855 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:13.099156 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:13.099958 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:13.248456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:13.256380 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-e8a17a1a-8e57-450d-ae2c-c8dfad1d6dce tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.177829 Jan 10 12:58:13.256930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 588/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:13 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:14.275879 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:14.276517 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:14.284006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:14.284477 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:14.285267 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:14.285697 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:14.438581 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:14.446355 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-eee5069d-70d3-442a-9830-d8a2b021afe3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.176416 Jan 10 12:58:14.446943 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 609/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:14 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:15.466190 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:15.467006 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:15.473486 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:15.473933 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:15.474707 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:15.475124 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:15.616069 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:15.624329 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4b10f279-5ff5-4e00-81a8-65b91d9e5186 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.162215 Jan 10 12:58:15.624915 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 589/1198] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:15 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:16.645665 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:16.646617 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:16.657496 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:16.658313 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:16.659672 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:16.660413 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:16.806231 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:16.817708 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-84565f9e-acc1-434a-968c-4295d94abd53 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.177997 Jan 10 12:58:16.818576 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 610/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:16 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:17.842044 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:17.843028 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:17.853202 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:17.853820 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:17.854912 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:17.855472 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:18.003156 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:18.015383 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-48db6498-5e58-42c7-840d-57cc941b2b98 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.179442 Jan 10 12:58:18.015977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 590/1200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:17 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:19.036678 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:19.037609 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:19.047120 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:19.047622 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:19.048402 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:19.048846 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:19.184087 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:19.195791 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-381352c6-9cda-476b-b197-38a28927e180 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.165036 Jan 10 12:58:19.196588 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 611/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:19 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:20.215747 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:20.216482 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:20.225550 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:20.226180 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:20.227404 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:20.228143 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:20.371891 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:20.379456 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-600fc236-1cdd-4d16-af97-149b9ef38dda tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.168001 Jan 10 12:58:20.380059 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 591/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:20 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:21.400276 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:21.401436 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:21.410271 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:21.410725 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:21.411495 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:21.411963 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:21.558073 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:21.567945 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-7595b5f8-256f-404e-a8ef-4cf43cc04288 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1509 microversion: 2.1 time: 0.173966 Jan 10 12:58:21.568522 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 612/1203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:21 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:21.585009 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-53a56741-c626-47b9-b41a-d152fe5d32d4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:58:21.585553 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-53a56741-c626-47b9-b41a-d152fe5d32d4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:21.592051 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53a56741-c626-47b9-b41a-d152fe5d32d4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:21.592495 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53a56741-c626-47b9-b41a-d152fe5d32d4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:21.593349 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53a56741-c626-47b9-b41a-d152fe5d32d4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:21.593742 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-53a56741-c626-47b9-b41a-d152fe5d32d4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:21.733694 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-53a56741-c626-47b9-b41a-d152fe5d32d4 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "POST /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5/action" status: 202 len: 0 microversion: 2.1 time: 0.152390 Jan 10 12:58:21.734963 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 592/1204] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jan 10 12:58:21 2022] POST /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 12:58:21.742699 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:21.743318 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:21.749390 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:21.750097 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:21.750899 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:21.751336 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:21.902061 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:21.910031 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-c002110d-d340-4e12-8921-284eb524657b tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1517 microversion: 2.1 time: 0.170937 Jan 10 12:58:21.910538 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 613/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:21 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:22.929977 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:22.930552 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:22.940359 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:22.941073 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:22.942376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:22.943095 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:23.091305 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:23.099424 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-bd9e761c-439d-42f8-82b2-ef375f26a98e tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1575 microversion: 2.1 time: 0.175757 Jan 10 12:58:23.100039 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 593/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:22 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:23.609027 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-59e09ca1-249c-42eb-88f1-f6919fa87529 req-276cfedf-3666-4173-b02f-210466c000f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca61f694-b312-4aef-918b-87a6983887f5", "name": "network-vif-unplugged", "status": "completed", "tag": "8b1a545a-d619-434d-9274-e46c6b717505"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:58:23.611835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:58:23.611835 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:58:23.619436 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-59e09ca1-249c-42eb-88f1-f6919fa87529 req-276cfedf-3666-4173-b02f-210466c000f9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:23.620115 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-59e09ca1-249c-42eb-88f1-f6919fa87529 req-276cfedf-3666-4173-b02f-210466c000f9 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:23.632088 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-59e09ca1-249c-42eb-88f1-f6919fa87529 req-276cfedf-3666-4173-b02f-210466c000f9 service nova] Creating event network-vif-unplugged:8b1a545a-d619-434d-9274-e46c6b717505 for instance ca61f694-b312-4aef-918b-87a6983887f5 on hv-cinder-maste Jan 10 12:58:23.637222 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-59e09ca1-249c-42eb-88f1-f6919fa87529 req-276cfedf-3666-4173-b02f-210466c000f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106587 Jan 10 12:58:23.637782 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 614/1207] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:58:24.120578 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:24.121427 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:24.132218 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:24.132971 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:24.134265 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:24.134997 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:24.290117 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:24.298541 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8a68cece-e66b-40aa-b1c0-d1bc4b486ba5 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1575 microversion: 2.1 time: 0.184407 Jan 10 12:58:24.299110 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 594/1208] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:24 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:25.321801 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:25.322984 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:25.333646 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:25.334392 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:25.335721 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:25.336464 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:25.479560 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:25.487940 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-160fe91e-9636-4ba5-b88c-1aa5cf62267f tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1575 microversion: 2.1 time: 0.173820 Jan 10 12:58:25.488497 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 615/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:25 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:26.509052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:26.510124 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:26.519562 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:26.520025 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:26.520815 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:26.521268 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:26.669825 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:26.681621 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-ad1ce5f3-6f07-4e14-8cc5-140772645e74 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1575 microversion: 2.1 time: 0.178642 Jan 10 12:58:26.682397 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 595/1210] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:26 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:27.704300 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:27.705451 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:27.712021 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:27.712470 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:27.713242 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:27.713674 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:27.863208 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:27.874452 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-cc5f5939-5bac-4de5-aca1-dd73a3fe6be7 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1575 microversion: 2.1 time: 0.173722 Jan 10 12:58:27.875285 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 616/1211] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:27 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:28.891333 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:28.891935 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:28.899021 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:28.899500 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:28.900299 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:28.900732 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:29.038869 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:29.051101 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-8ab55162-af7d-493a-9b68-5ce12c389a2d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1575 microversion: 2.1 time: 0.163262 Jan 10 12:58:29.051930 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 596/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:28 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:30.077339 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:30.078262 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:30.085475 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:30.085929 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:30.086716 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:30.087155 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:30.242044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:30.253479 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-3eb11c1f-463c-4ec1-aee1-03d80bf35d21 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1575 microversion: 2.1 time: 0.182514 Jan 10 12:58:30.254161 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 617/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:30 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:31.281000 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:58:31.282067 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:58:31.289589 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:31.290040 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:31.290826 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:31.291261 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:31.435407 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:58:31.443684 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-4122185c-3d53-4187-9668-0b6326d7df68 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1562 microversion: 2.1 time: 0.168979 Jan 10 12:58:31.444234 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 597/1214] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:58:31 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:58:33.636670 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-55d3183e-cb80-4861-a521-d096332ea3a4 req-70ae8322-2798-43e3-969d-4235e9858c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca61f694-b312-4aef-918b-87a6983887f5", "name": "network-vif-plugged", "status": "completed", "tag": "8b1a545a-d619-434d-9274-e46c6b717505"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:58:33.638287 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:58:33.638287 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:58:33.646019 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-55d3183e-cb80-4861-a521-d096332ea3a4 req-70ae8322-2798-43e3-969d-4235e9858c61 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:58:33.646480 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-55d3183e-cb80-4861-a521-d096332ea3a4 req-70ae8322-2798-43e3-969d-4235e9858c61 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:58:33.658094 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-55d3183e-cb80-4861-a521-d096332ea3a4 req-70ae8322-2798-43e3-969d-4235e9858c61 service nova] Creating event network-vif-plugged:8b1a545a-d619-434d-9274-e46c6b717505 for instance ca61f694-b312-4aef-918b-87a6983887f5 on hv-cinder-maste Jan 10 12:58:33.663891 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-55d3183e-cb80-4861-a521-d096332ea3a4 req-70ae8322-2798-43e3-969d-4235e9858c61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030882 Jan 10 12:58:33.664530 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 618/1215] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:59:47.940862 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:59:47.941435 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:59:47.947973 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:47.948504 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:47.949373 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:47.949858 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:47.978077 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Going to try to terminate instance {{(pid=123138) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 12:59:47.999531 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-730f45a3-7576-4e40-a169-fd6f3f2b5600 req-d904e7af-2083-4bdd-ae85-b3b2a450c2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca61f694-b312-4aef-918b-87a6983887f5", "tag": "8b1a545a-d619-434d-9274-e46c6b717505"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:59:48.001076 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:59:48.001076 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:59:48.008481 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-730f45a3-7576-4e40-a169-fd6f3f2b5600 req-d904e7af-2083-4bdd-ae85-b3b2a450c2aa service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:48.008930 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-730f45a3-7576-4e40-a169-fd6f3f2b5600 req-d904e7af-2083-4bdd-ae85-b3b2a450c2aa service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:48.021556 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-730f45a3-7576-4e40-a169-fd6f3f2b5600 req-d904e7af-2083-4bdd-ae85-b3b2a450c2aa service nova] Creating event network-changed:8b1a545a-d619-434d-9274-e46c6b717505 for instance ca61f694-b312-4aef-918b-87a6983887f5 on hv-cinder-maste Jan 10 12:59:48.027648 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-730f45a3-7576-4e40-a169-fd6f3f2b5600 req-d904e7af-2083-4bdd-ae85-b3b2a450c2aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089043 Jan 10 12:59:48.031362 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 619/1216] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 12:59:48.068330 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-280754cb-0829-401a-9580-e4152e5340bf tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 204 len: 0 microversion: 2.1 time: 0.131480 Jan 10 12:59:48.068853 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 598/1217] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jan 10 12:59:47 2022] DELETE /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 12:59:48.077751 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:59:48.079201 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:59:48.086476 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:48.087255 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:48.088276 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:48.088900 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:48.226513 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.policy [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123137) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:59:48.236053 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-e55e61e8-451f-45a1-9692-a5d48e71c402 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1568 microversion: 2.1 time: 0.162359 Jan 10 12:59:48.239157 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 620/1218] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:59:48 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:59:49.257034 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:59:49.257775 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:59:49.264877 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:49.265349 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:49.266171 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:49.266626 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:49.411348 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:59:49.419664 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-b51732dc-8337-41b9-8dcd-909d36b8147d tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1449 microversion: 2.1 time: 0.167671 Jan 10 12:59:49.420215 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 599/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:59:49 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:59:50.318502 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [req-73172356-a1e7-4fa4-aaaf-cd7bb5b4d8eb req-58ade25e-f44f-416b-b925-8738fa343fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca61f694-b312-4aef-918b-87a6983887f5", "name": "network-vif-deleted", "tag": "8b1a545a-d619-434d-9274-e46c6b717505"}]} {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 12:59:50.319671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:59:50.319671 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: warnings.warn(msg) Jan 10 12:59:50.328696 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-73172356-a1e7-4fa4-aaaf-cd7bb5b4d8eb req-58ade25e-f44f-416b-b925-8738fa343fa1 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:50.329713 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [req-73172356-a1e7-4fa4-aaaf-cd7bb5b4d8eb req-58ade25e-f44f-416b-b925-8738fa343fa1 service nova] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:50.341878 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.compute.server_external_events [req-73172356-a1e7-4fa4-aaaf-cd7bb5b4d8eb req-58ade25e-f44f-416b-b925-8738fa343fa1 service nova] Creating event network-vif-deleted:8b1a545a-d619-434d-9274-e46c6b717505 for instance ca61f694-b312-4aef-918b-87a6983887f5 on hv-cinder-maste Jan 10 12:59:50.347541 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [req-73172356-a1e7-4fa4-aaaf-cd7bb5b4d8eb req-58ade25e-f44f-416b-b925-8738fa343fa1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Jan 10 12:59:50.348572 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 621/1220] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jan 10 12:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 12:59:50.439778 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:59:50.440376 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.compute.api [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123138) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:59:50.447332 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:50.447781 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:50.448612 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:50.449052 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG oslo_concurrency.lockutils [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123138) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:50.512249 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.policy [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59a1dbec22e452081ff7c6e6242cadc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6274f5b54d23499882aaa38eced195e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123138) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 12:59:50.520571 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-0effa4a5-3f5a-49ba-9394-8fa1cb2c9e27 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 200 len: 1219 microversion: 2.1 time: 0.084447 Jan 10 12:59:50.521232 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 600/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:59:50 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 12:59:51.544383 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '>' {{(pid=123137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:59:51.545527 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.compute.api [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] [instance: ca61f694-b312-4aef-918b-87a6983887f5] Fetching instance by UUID {{(pid=123137) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 12:59:51.557340 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:51.558077 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:51.559353 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 12:59:51.560121 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG oslo_concurrency.lockutils [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Lock "d03a79a3-f043-4ae0-9ae4-2ca83e1a8894" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 12:59:51.582758 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.wsgi [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] HTTP exception thrown: Instance ca61f694-b312-4aef-918b-87a6983887f5 could not be found. Jan 10 12:59:51.583733 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: DEBUG nova.api.openstack.wsgi [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Returning 404 to user: Instance ca61f694-b312-4aef-918b-87a6983887f5 could not be found. {{(pid=123137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 12:59:51.584578 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO nova.api.openstack.requestlog [None req-860f6411-bbfc-457f-b257-345d1a3ba4d3 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5" status: 404 len: 111 microversion: 2.1 time: 0.047247 Jan 10 12:59:51.585114 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: [pid: 123137|app: 0|req: 622/1222] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jan 10 12:59:51 2022] GET /compute/v2.1/servers/ca61f694-b312-4aef-918b-87a6983887f5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 12:59:51.746700 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: DEBUG nova.api.openstack.wsgi [None req-1dd80b7c-7c6a-4078-8556-7cee4b494605 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] Calling method '.version_select at 0x7f7fca747670>' {{(pid=123138) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 12:59:51.770075 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO nova.api.openstack.requestlog [None req-1dd80b7c-7c6a-4078-8556-7cee4b494605 tempest-TestShelveInstance-1198392963 tempest-TestShelveInstance-1198392963-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1716586870" status: 202 len: 0 microversion: 2.1 time: 0.027013 Jan 10 12:59:51.771043 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: [pid: 123138|app: 0|req: 601/1223] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Jan 10 12:59:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1716586870 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 13:00:59.966976 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:00:59.968132 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: Mon Jan 10 13:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:01:01.181839 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:01:01.182462 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: Mon Jan 10 13:01:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:01:03.202006 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:01:03.202881 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: Mon Jan 10 13:01:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:02:18.957193 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:02:18.958314 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: Mon Jan 10 13:02:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:02:58.096412 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:02:58.097239 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: Mon Jan 10 13:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:04:19.982271 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:04:19.983175 dv-cinder-master-3-iscsi devstack@n-api.service[123138]: Mon Jan 10 13:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:04:21.192044 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:04:21.193133 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: Mon Jan 10 13:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:04:23.213737 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:04:23.214751 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: Mon Jan 10 13:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 13:04:50.354684 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 13:04:50.355847 dv-cinder-master-3-iscsi devstack@n-api.service[123137]: Mon Jan 10 13:04:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!